Elasticsearch: Mining Metrics from Logs

A presentation at Stoke-On-Tech October 2018 in in Stoke-on-Trent, UK by Jonathan Relf

ELASTICSEARCH: MINING METRICS FROM LOGS

ELASTICSEARCH: MINING METRICS FROM LOGS

About Commify

About Commify

Title Slide

Title Slide

Seeing Inside

Seeing Inside

The Power of Logs

The Power of Logs

The Trouble with Logs

The Trouble with Logs

The Power of Metrics

The Power of Metrics

The Trouble with Metrics

The Trouble with Metrics

Initial reaction to metrics

Initial reaction to metrics

The start of metrics at Esendex

The start of metrics at Esendex

'Pulse'

'Pulse'

'Pulse' - zoomed

'Pulse' - zoomed

Shifting balance

Shifting balance

Elastic Stack

Elastic Stack

Centralised Logging

Centralised Logging

Metrics with Metadata

Metrics with Metadata

Json Log documents

Json Log documents

Correlations: 15 minute snapshot

Correlations: 15 minute snapshot

Sample Metrics

Sample Metrics

Sample Metics - zoomed

Sample Metics - zoomed

Drilling down

Drilling down

Drilling down - zoomed

Drilling down - zoomed

Kibana in action

Kibana in action

Visualisation drill-downs

Visualisation drill-downs

Dashboards

Dashboards

Using Elasticsearch with Grafana

Using Elasticsearch with Grafana

Challenges

Challenges

Next Steps

Next Steps

Timelion

Timelion

Timelion screenshot

Timelion screenshot

Machine Learning

Machine Learning

Machine Learning screenshot

Machine Learning screenshot

Elastic Stack benefits

Elastic Stack benefits

Metrics with metadata proposition

Metrics with metadata proposition

Elastic Stack power

Elastic Stack power

Additional X-Pack benefits

Additional X-Pack benefits

Summary

Summary

Questions?

Questions?

About Me

About Me

Resources

The following resources were mentioned during the presentation or are useful additional information.

Buzz and feedback

Here’s what was said about this presentation on Twitter.