@rawkode Good Afternoon David McKay @rawkode Developer Advocate @InfluxDB | #InfluxDB PHPUK 2020
A presentation at PHPUK 2020 in February 2020 in England, UK by David McKay
@rawkode Good Afternoon David McKay @rawkode Developer Advocate @InfluxDB | #InfluxDB PHPUK 2020
@rawkode π΄σ §σ ’σ ³σ £σ ΄σ Ώ Scottish David Mckay Developer Advocate π Has 9 Pets at InfluxData π Esoteric Programming Languages @rawkode βΈ Kubernetes Team π€ Stoic
Introduction to Time Series
@rawkode Before we begin β¦
@rawkode Pop Quiz βInventedβ When?
@rawkode Encoding First Used β¦ 410 ? BC
@rawkode Encoding βDocumentedβ in The Lives of the Noble Grecians and Romans, by Roman historian Plutarch.
@rawkode Alcibiades suddenly raised the Athenian ensign in the admiral shop, and fell upon those galleys of the Peloponnesians β¦
@rawkode Encoding In the 14th century, things hadnβt actually advanced much more. The Black Book of Admiralty listed 2 signals: 1 flag or 2 flags
@rawkode Encoding By the 15th century there were 15 flags, each with a single meaning.
@rawkode Encoding Finally, in the late 17th century; a French system existed (MahΓ© de la Bourdonnais) with 10 coloured flags, representing 0-9
@rawkode Sharding First Used β¦ 150 ? BC
@rawkode Sharding First βdocumentedβ example was in ~150 AD, invented and described by Polybius.
@rawkode We take the alphabet and divide it into five parts, each consisting of five letters.
@rawkode
@rawkode
History of Time Series
@rawkode The Romans Did It The earliest form of a company which issued public shares was the case of the publicani during the Roman Republic.
@rawkode Like modern joint-stock companies, the publicani were legal bodies independent of their members whose ownership was divided into shares, or partes. There is evidence that these shares were sold to public investors and traded in a type of over-the-counter market in the Forum, near the Temple of Castor and Pollux. The shares fluctuated in value, encouraging the activity of speculators, or quaestors.
@rawkode In 1602 β¦ First IPO: Dutch East India Company
@rawkode In 1873 β¦ First US IPO: Bank of North America
@rawkode In 1884 β¦ What was the price of wheat?
@rawkode First Documented Time Series A Comparison of the Fluctuations in the Price of Wheat and in the Cotton and Silk Imports into Great Britain J. H. Poynting Journal of the Statistical Society of London Vol. 47, No. 1 (Mar., 1884), pp. 34-74
@rawkode What is all this? This is the first (or one of) paper that added the dimension of time to statistical mathematics
@rawkode Most data is best understood in the dimension of time @pauldix, CTO
Introduction to Time Series
@rawkode What Will We Cover? β β β β β Time Series Data Time Series Databases Getting to Know InfluxDB Value of Time Series Data Advancing Monitoring with Time Series
Time Series Data What is it?
@rawkode Time Series Data Data with a timestamp
@rawkode Mem 100% Healthcheck Failed Pod Killed By OOM V1.1.3 Deployed Git Commit Pod Restarted CPU 12% Scotland Qualify for World Cup DB Migration Run CI Passed CI Started
@rawkode Mem 100% Healthcheck Failed Pod Killed By OOM V1.1.3 Deployed Git Commit Pod Restarted CPU 12% Scotland Qualify for World Cup DB Migration Run CI Passed CI Started
@rawkode Mem 100% Healthcheck Failed Pod Killed By OOM V1.1.3 Deployed Git Commit Pod Restarted CPU 12% Scotland Qualify for World Cup DB Migration Run CI Passed CI Started
@rawkode Mem 100% Healthcheck Failed Pod Killed By OOM V1.1.3 Deployed Git Commit Pod Restarted CPU 12% Scotland Qualify for World Cup DB Migration Run CI Passed CI Started
@rawkode Mem 100% Healthcheck Failed Pod Killed By OOM V1.1.3 Deployed Git Commit Pod Restarted CPU 12% Scotland Qualify for World Cup DB Migration Run CI Passed CI Started
@rawkode Mem 100% Pod Killed By OOM V1.1.3 Deployed Time DB Migration Run Healthcheck Failed
@rawkode What is Time Series Data?
@rawkode What is Time Series Data? Regular (Metrics) β Predictable β Evenly Distributed Irregular (Events) β Unpredictable β Inconsistent Intervals
@rawkode Regular / Metrics β β β β CPU Usage Memory Usage Ping Time for Google.com Number of Processes
@rawkode Irregular / Events β β β β User Clicked Login Authentication Failed CI Published v1.3.1 Network Cable Unplugged
@rawkode Metrics vs. Events All Metrics are an aggregation of events
@rawkode Collecting Metrics & Events With Prometheus Exporters or Telegraf
@rawkode Collecting Metrics & Events Inputs: β β β β β β β β β CloudWatch Elasticsearch Kafka Jenkins Kubernetes Linux Puppet Windows x509 Outputs: β β β β β β CloudWatch Kafka DataDog Elasticsearch Graphite Prometheus Exporters: β β β β β β Atlassian Ceph Consul Kubernetes Memcached MySQL
@rawkode Push AND Pull Metrics are pulled at a regular interval Events NEED to be pushed as they happen Consistent and reliable intervals Inconsistent intervals
@rawkode Time Series Data Use Cases
@rawkode Use Cases for Time Series Monitoring β β β Infrastructure Applications Third Party Services IoT / Sensor β β β β β Thermostats Electric Engines Smart Things GPS Fitbits Real Time Analytics β β β Website Tracking Stock Prices Currency Exchange Rates
Time Series Databases TSDBβs
@rawkode Time Series Databases Time Series databases are optimized for collecting, storing, retrieving, and processing of Time Series data.
@rawkode Time Series Databases β High Write Frequency β Reads are range scans β TTL / Lifecycle Management β Time Sensitive
@rawkode 12% Are you in the 88%?
@rawkode 13% Itβs Not Too Late!
@rawkode
@rawkode Disclaimer Most of this isnβt unique to InfluxDB
InfluxDB Introductions
@rawkode InfluxDB β TSDB β Open-Source β FullStack (Telegraf, InfluxDB, Chronograf, and Kapacitor) β v2 β¦
@rawkode Points At any point in time, this value was N
@rawkode Point β Series β Fields β Timestamp load,host=vm1 1m=6.32,5m=8.20,15m=9.55 123456789
@rawkode Series β Name β Tag Keys β Tag Values β load,host=vm1 β stock_price,market=NASDAQ,ticker=GOOG β users,service=comments
@rawkode Series β Name β Tag Keys β Tag Values stock_price,market=NASDAQ,ticker=GOOG stock_price,market=NASDAQ,ticker=APPL
@rawkode Tags & Fields Tags β Indexed β String Types Fields β Not Indexed β Multiple Data Types
Value of Time Series Data Isnβt It Valuable Forever?
@rawkode Resolution The predictable interval at which we will collect our time series data
@rawkode Value of Time Series Data The value of all time series data is directly correlated with the resolution that the data is available
Cost of Time Series Data Wait, Isnβt It Free?!
@rawkode Example cpu,machine=abc1 usage=1.66 timestamp
@rawkode Resolution β 1 Measurement β 1 Series β 1s Resolution 86400 Points Per Day
@rawkode Resolution β 1 Measurement β 2 Series β 1s Resolution 172800 Points Per Day
@rawkode Resolution β 5 Measurement β 10 Series β 1s Resolution 4320000 Points Per Day
@rawkode Nasdaq β 1 Measurement β 3300 Series β 1ms Resolution 28512000 0000 Points Per Day
@rawkode Nasdaq β 1 Measurement β 3300 Series β 1m Resolution 4752000 Points Per Day
@rawkode Nasdaq β 1 Measurement β 3300 Series β 1h Resolution 79200 Points Per Day
@rawkode Nasdaq β 1 Measurement β 3300 Series β 6h Resolution 13200 Points Per Day
@rawkode Downsampling Lowering the Resolution
@rawkode Rollups with Continuous Queries CREATE CONTINUOUS QUERY βrollup_1hβ ON βnasdaqβ BEGIN SELECT mean(price) INTO yearly FROM weekly GROUP BY time(1h) END
@rawkode Events? Outlier / Anomaly Detection InfluxDB Anomaly Detection
Advancing Monitoring with Time Series Taking Small Steps for Giant Leaps
CPU > 80% MEM > 80% Application Database Response Time > 300ms Black Friday
Application When the application fails the health-check How do we know when to send a page to SRE / Ops? Database
Application How do we know when to send a page to SRE / Ops? Application Database Application When we get more than 100 [ 5xx | Exceptions ] within a 5 minute period
Service A Service B Service B Service C Canary Virtual Network Service Mesh Ummm? Database A Database B Database C
@rawkode Cloud Native Architectures Convenience Vs. Cost You can treat the symptoms for a while β¦ Upgrade Your Monitoring
@rawkode Causality Treating the Disease
@rawkode Causality β Look at last weeks, months, and years of data β Use tags to build correlation β Get Statistical β β β β β β INTEGRAL() LINEAR_PREDICTION() DERIVATIVE() MAD() MOVING_AVERAGE() HOLT_WINTERS()
@rawkode Causality Have you ever been paged at 4am because the disk usage of a machine went above 85%? Could this have been determined during office hours? (Linear Growth) Can we use correlations to determine the cause during anomalies?
@rawkode Causality In our distributed application, our p99 reports that our users are being served healthy responses in under 2ms. Our pager is going off because weβve getting too many exceptions in the code histogram(bins: [β¦])
@rawkode Beware http_request_duration_seconds_bucket{le=β0.3β} http_request_duration_seconds_bucket{le=β0.5β} http_request_duration_seconds_bucket{le=β1.0β} http_request_duration_seconds_bucket{le=β+Infβ}
@rawkode Causality In our distributed application, our p99 reports that our users are being served healthy responses in under 2ms. Our pager is going off because weβve getting too many exceptions in the code histogram() |> mode(*)
@rawkode Proactive Ops We run Big News Corp and we need to reduce our cloud costs. Instead of running at 30% utilisation, can we run at 80% utilisation? HOLT_WINTERS
@rawkode Build Automation Through Causality, Historical Data, Prediction, and ML
@rawkode Summary β Use a TSDB β Rollup metrics β Understand Cost / Select Tags Wisely β Perform outlier detection on events β Understand the resolution you need for 1m, 6m, > 12m β Build automation, dashboarding, and reporting around your data (past, present, and future)
@rawkode Cheers! David McKay @rawkode Developer Advocate @InfluxDB | #InfluxDB Thatβs All Folks!
