netdata (1.6.0) - 2017-03-20 * birthday release: 1 year netdata netdata was first published on March 30th, 2016. It has been a crazy year since then: 225.000 unique netdata users currently, at 1.000 new unique users per day 80.000 unique netdata installations currently, at 500 new installation per day 610.000 docker pulls on docker hub 4.000.000 netdata sessions served currently, at 15.000 sessions served per day 20.000 github stars Thank you! You are awesome! * central netdata is here This is the first release that supports real-time streaming of metrics between netdata servers. netdata can now be: - autonomous host monitoring (like it always has been) - headless data collector (collect and stream metrics in real-time to another netdata) - headless proxy (collect metrics from multiple netdata and stream them to another netdata) - store and forward proxy (like headless proxy, but with a local database) - central database (metrics from multiple hosts are aggregated) metrics databases can be configured on all nodes and each node maintaining a database may have a different retention policy and possibly run (even different) alarms on them. * monitoring ephemeral nodes netdata now supports monitoring autoscaled ephemeral nodes, that are started and stopped on demand (their IP is not known). When the ephemeral nodes start streaming metrics to the central netdata, the central netdata will show register them at "my-netdata" menu on the dashboard. For more information check: https://github.com/firehol/netdata/wiki/monitoring-ephemeral-nodes * monitoring ephemeral containers and VM guests netdata now cleans up container, guest VM, network interfaces and mounted disk metrics, disabling automatically their alarms too. For more information check: https://github.com/firehol/netdata/wiki/monitoring-ephemeral-containers * apps.plugin ported for FreeBSD @vlvkobal has ported "apps.plugin" to FreeBSD. netdata can now provide "Applications", "Users" and "User Groups" on FreeBSD. * web_log plugin @l2isbad has done a wonderful job creating a unified web log parsing plugin for all kinds of web server logs. With it, netdata provides real-time performance information and health monitoring alarms for web applications and web sites! For more information check: https://github.com/firehol/netdata/wiki/The-spectacles-of-a-web-server-log-file * backends netdata can now archive metrics to `JSON` backends (both push, by @lfdominguez, and pull modes). * IPMI monitoring netdata now has an IPMI plugin (based on freeipmi) for monitoring server hardware. The plugin creates (up to) 8 charts: 1. number of sensors by state 2. number of events in SEL 3. Temperatures CELCIUS 4. Temperatures FAHRENHEIT 5. Voltages 6. Currents 7. Power 8. Fans It also supports alarms (including the number of sensors in critical state). For more information, check: https://github.com/firehol/netdata/wiki/monitoring-IPMI * new plugins @l2isbad builds python data collection plugins for netdata at an wonderfull rate! He rocks! - **web_log** for monitoring in real-time all kinds of web server log files @l2isbad - **freeipmi** for monitoring IPMI (server hardware) - **nsd** (the [name server daemon](https://www.nlnetlabs.nl/projects/nsd/)) @383c57 - **mongodb** @l2isbad - **smartd_log** (monitoring disk S.M.A.R.T. values) @l2isbad * improved plugins - **nfacct** reworked and now collects connection tracker information using netlink. - **ElasticSearch** re-worked @l2isbad - **mysql** re-worked to allow faster development of custom mysql based plugins (MySQLService) @l2isbad - **SNMP** - **tomcat** @NMcCloud - **ap** (monitoring hostapd access points) - **php_fpm** @l2isbad - **postgres** @l2isbad - **isc_dhcpd** @l2isbad - **bind_rndc** @l2isbad - **numa** - **apps.plugin** improvements and freebsd support @vlvkobal - **fail2ban** @l2isbad - **freeradius** @l2isbad - **nut** (monitoring UPSes) - **tc** (Linux QoS) now works on qdiscs instead of classes for the same result (a lot faster) @t-h-e - **varnish** @l2isbad * new and improved alarms - **web_log**, many alarms to detect common web site/API issues - **fping**, alarms to detect packet loss, disconnects and unusually high latency - **cpu**, cpu utilization alarm now ignores `nice` * new and improved alarm notification methods - **HipChat** to allow hosted HipChat @frei-style - **discordapp** @lowfive * dashboard improvements - dashboard now works on HiDPi screens - dashboard now shows version of netdata - dashboard now resets charts properly - dashboard updated to use latest gauge.js release * other improvements - thanks to @rlefevre netdata now uses a lot of different high resolution system clocks. netdata has received a lot more improvements from many more contributors! Thank you all! netdata (1.5.0) - 2017-01-22 * yet another release that makes netdata the fastest netdata ever! * netdata runs on FreeBSD, FreeNAS and MacOS ! Vladimir Kobal (@vlvkobal) has done a magnificent work porting netdata to FreeBSD and MacOS. Everyhing works: cpu, memory, disks performance, disks space, network interfaces, interrupts, IPv4 metrics, IPv6 metrics processes, context switches, softnet, IPC queues, IPC semaphores, IPC shared memory, uptime, etc. Wow! * netdata supports data archiving to backend databases: - Graphite - OpenTSDB - Prometheus and of course all the compatible ones (KairosDB, InfluxDB, Blueflood, etc) * new plugins: Ilya Mashchenko (@l2isbad) has created most of the python data collection plugins in this release ! - systemd Services (using cgroups!) - FPing (yes, network latency in netdata!) - postgres databases @facetoe, @moumoul - Vanish disk cache (v3 and v4) @l2isbad - ElasticSearch @l2isbad - HAproxy @l2isbad - FreeRadius @l2isbad, @lgz - mdstat (RAID) @l2isbad - ISC bind (via rndc) @l2isbad - ISC dhcpd @l2isbad, @lgz - Fail2Ban @l2isbad - OpenVPN status log @l2isbad, @lgz - NUMA memory @tycho - CPU Idle @tycho - gunicorn log @deltaskelta - ECC memory hardware errors - IPC semaphores - uptime plugin (with a nice badge too) * improved plugins: - netfilter conntrack - mysql (replication) @l2isbad - ipfs @pjz - cpufreq @tycho - hddtemp @l2isbad - sensors @l2isbad - nginx @leolovenet - nginx_log @paulfantom - phpfpm @leolovenet - redis @leolovenet - dovecot @justohall - cgroups - disk space - apps.plugin - /proc/interrupts @rlefevre - /proc/softirqs @rlefevre - /proc/vmstat (system memory charts) - /proc/net/snmp6 (IPv6 charts) - /proc/self/meminfo (system memory charts) - /proc/net/dev (network interfaces) - tc (linux QoS) * new/improved alarms: - MySQL / MariaDB alarms (incl. replication) - IPFS alarms - HAproxy alarms - UDP buffer alarms - TCP AttemptFails - ECC memory alarms - netfilter connections alarms - SNMP * new alarm notifications: - messagebird.com @tech-no-logical - pagerduty.com @jimcooley - pushbullet.com @tperalta82 - twilio.com @shadycuz - HipChat - kafka * shell integration - shell scripts can now query netdata easily! * dashboard improvements: - dashboard is now faster on firefox, safari, opera, edge (edge is still the slowest) - dashboard now has a little bigger fonts - SHIFT + mouse wheel to zoom charts, works on all browsers - perfect-scrollbar on the dashboard - dashboard 4K resolution fixes - dashboard compatibility fixes for embedding charts in third party web sites - charts on custom dashboards can have common min/max even if they come from different netdata servers - alarm log is now saved and loaded back so that the alarm history is available at the dashboard * other improvements: - python.d.plugin has received way to many improvements from many contributors! - charts.d.plugin can now be forked to support multiple independent instances - registry has been re-factored to lower its memory requirements (required for the public registry) - simple patterns in cgroups, disks and alarms - netdata-installer.sh can now correctly install netdata in containers - supplied logrotate script compatibility fixes - spec cleanup @breed808 - clocks and timers reworked @rlefevre netdata has received a lot more improvements from many more contributors! Thank you all guys! netdata (1.4.0) - 2016-10-04 At a glance: - the fastest netdata ever (with a better look too)! - improved IoT and containers support! - alarms improved in almost every way! - new plugins: softnet netdev, extended TCP metrics, UDPLite NFS v2, v3 client (server was there already), NFS v4 server & client, APCUPSd, RetroShare - improved plugins: mysql, cgroups, hddtemp, sensors, phpfm, tc (QoS) In detail: * improved alarms Many new alarms have been added to detect common kernel configuration errors and old alarms have been re-worked to avoid notification floods. Alarms now support notification hysteresis (both static and dynamic), notification self-cancellation, dynamic thresholds based on current alarm status * improved alarm notifications netdata now supports: - email notifications - slack.com notifications on slack channels - pushover.net notifications (mobile push notifications) - telegram.org notifications For all the above methods, netdata supports role-based notifications, with multiple recipients for each role and severity filtering per recipient! Also, netdata support HTML5 notifications, while the dashboard is open in a browser window (no need to be the active one). All notifications are now clickable to get to the chart that raised the alarm. * improved IoT support! netdata builds and runs with musl libc and runs on systems based on busybox. * improved containers support! netdata runs on alpine linux (a low profile linux distribution used in containers). * Dozens of other improvements and bugfixes netdata (1.3.0) - 2016-08-28 At a glance: - netdata has health monitoring / alarms! - netdata has badges that can be embeded anywhere! - netdata plugins are now written in Python! - new plugins: redis, memcached, nginx_log, ipfs, apache_cache IMPORTANT: Since netdata now uses Python plugins, new packages are required to be installed on a system to allow it work. For more information, please check the installation page: https://github.com/firehol/netdata/wiki/Installation In detail: * netdata has alarms! Based on the POLL we made on github (https://github.com/firehol/netdata/issues/436), health monitoring was the winner. So here it is! netdata now has a poweful health monitoring system embedded. Please check the wiki page: https://github.com/firehol/netdata/wiki/health-monitoring * netdata has badges! netdata can generate badges with live information from the collected metrics. Please check the wiki page: https://github.com/firehol/netdata/wiki/Generating-Badges * netdata plugins are now written in Python! Thanks to the great work of Paweł Krupa (@paulfantom), most BASH plugins have been ported to Python. The new python.d.plugin supports both python2 and python3 and data collection from multiple sources for all modules. The following pre-existing modules have been ported to Python: - apache - cpufreq - example - exim - hddtemp - mysql - nginx - phpfm - postfix - sensors - squid - tomcat The following new modules have been added: - apache_cache - dovecot - ipfs - memcached - nginx_log - redis * other data collectors: - Thanks to @simonnagl netdata now reports disk space usage. * dashboards now transfer a certain settings from server to server when changing servers via the my-netdata menu. The settings transferred are the dashboard theme, the online help status and current pan and zoom timeframe of the dashboard. * API improvements: - reduction functions now support 'min', 'sum' and 'incremental-sum'. - netdata now offers a multi-threaded and a single threaded web server (single threaded is better for IoT). * apps.plugin improvements: - can now run with command line argument 'without-files' to prevent it from enumating all the open files/sockets/pipes of all running processes. - apps.plugin now scales the collected values to match the the total system usage. - apps.plugin can now report guest CPU usage per process. - repeating errors are now logged once per process. * netdata now runs with IDLE process priority (lower than nice 19) * netdata now instructs the kernel to kill it first when it starves for memory. * netdata listens for signals: - SIGHUP to netdata instructs it to re-open its log files (new logrotate files added too). - SIGUSR1 to netdata saves the database - SIGUSR2 to netdata reloads health / alarms configuration * netdata can now bind to multiple IPs and ports. * netdata now has new systemd service file (it starts as user netdata and does not fork). * Dozens of other improvements and bugfixes netdata (1.2.0) - 2016-05-16 At a glance: - netdata is now 30% faster - netdata now has a registry (my-netdata dashboard menu) - netdata now monitors Linux Containers (docker, lxc, etc) IMPORTANT: This version requires libuuid. The package you need is: - uuid-dev (debian/ubuntu), or - libuuid-devel (centos/fedora/redhat) In detail: * netdata is now 30% faster ! - Patches submitted by @fredericopissarra improved overall netdata performance by 10%. - A new improved search function in the internal indexes made all searches faster by 50%, resulting in about 20% better performance for the core of netdata. - More efficient threads locking in key components contributed to the overal efficiency. * netdata now has a CENTRAL REGISTRY ! The central registry tracks all your netdata servers and bookmarks them for you at the 'my-netdata' menu on all dashboards. Every netdata can act as a registry, but there is also a global registry provided for free for all netdata users! * netdata now monitors CONTAINERS ! docker, lxc, or anything else. For each container it monitors CPU, RAM, DISK I/O (network interfaces were already monitored) * apps.plugin: now uses linux capabilities by default without setuid to root * netdata has now an improved signal handler thanks to @simonnagl * API: new improved CORS support * SNMP: counter64 support fixed * MYSQL: more charts, about QCache, MyISAM key cache, InnoDB buffer pools, open files * DISK charts now show mount point when available * Dashboard: improved support for older web browsers and mobile web browsers (thanks to @simonnagl) * Multi-server dashboards now allow de-coupled refreshes for each chart, so that if one netdata has a network latency the other charts are not affected * Several other minor improvements and bugfixes netdata (1.1.0) - 2016-04-20 Dozens of commits that improve netdata in several ways: - Data collection: added IPv6 monitoring - Data collection: added SYNPROXY DDoS protection monitoring - Data collection: apps.plugin: added charts for users and user groups - Data collection: apps.plugin: grouping of processes now support patterns - Data collection: apps.plugin: now it is faster, after the new features added - Data collection: better auto-detection of partitions for disk monitoring - Data collection: better fireqos intergation for QoS monitoring - Data collection: squid monitoring now uses squidclient - Data collection: SNMP monitoring now supports 64bit counters - API: fixed issues in CSV output generation - API: netdata can now be restricted to listen on a specific IP - Core and apps.plugin: error log flood protection - Dashboard: better error handling when the netdata server is unreachable - Dashboard: each chart now has a toolbox - Dashboard: on-line help support - Dashboard: check for netdata updates button - Dashboard: added example /tv.html dashboard - Packaging: now compiles with musl libc (alpine linux) - Packaging: added debian packaging - Packaging: support non-root installations - Packaging: the installer generates uninstall script netdata (1.0.0) - 2016-03-22 - first public release netdata (1.0.0-rc.1) - 2015-11-28 - initial packaging