80 likes | 204 Views
TSDB EVOLUTION. Dave Webster. DOCCON1 September 2014. TSDB is great. TSDB IS GREAT. Tens of thousands of time series metrics Sourced from almost every machine across the PRODUCTION estate (800 plus) Samples between 1 and 60 seconds (mode 10) Retained for years No downsampling
E N D
TSDB EVOLUTION Dave Webster DOCCON1 September 2014
TSDB IS GREAT • Tens of thousands of time series metrics • Sourced from almost every machine across the PRODUCTION estate (800 plus) • Samples between 1 and 60 seconds (mode 10) • Retained for years • No downsampling • Numerous interfaces (Visualiser, native, radiator, confluence, metrilyx)
Simple architecture tcollector TSDB JMX OS statsE poller
There are limitations though… • Alerting and monitoring • Recency • Efficiency of polling • Tcollector efficiency • Jacek’s extras PERSIST vs STREAM
rewrite tcollector forwarder TSDB JMX OS statsE poller
rewrite tcollector forwarder TSDB JMX OS statsE poller Riemann Kale aggregator Nagios Plotting Health
TIME SERIES PIPELINE : A Summary • REAL TIME STREAM OF INVALUABLE METRICS • HIGH PERFORMANCE • Open source • ARGUABLY MORE IMPORTANT THAN TSDB