A presentation at Linuxing in London in in London, UK by Emanuil Tolev
NOW WHERE DID I LEAVE MY KEYS? @EMANUIL_TOLEV Community engineer at Elastic. ^ Ran a cluster, small co, on call, etc.
WHAT IS THE ELASTIC STACK?
Large open source projects: Elasticsearch, Kibana, Beats and Logstash ^ At the heart is Elasticsearch, an open source search and data analytics engine. ^ Kibana is an open source visualisations and dashboarding tool ^ The rest support logging, metrics and tracing, a use case with 1000s of big company and millions of smaller users.
Search. We often think of it as a needle in a haystack. Let’s have a look at some dictionary definitions.
SEARCH GENERAL: “try to find something by looking or otherwise seeking carefully and thoroughly.” COMPUTING: “the systematic retrieval of information, or the facility for this.” 2 examples: DOAJ and nuclear reactor database
VISUALISATION We’ll see many examples in a minute. But those are the two main principles underlying the technology: search (aka information retrieval) and summarising the information in visualisations. Everything is built on those two principles and they are the two core human cognitive processes that our tech enhances.
ELASTICSEARCH SCALES HORIZONTALLY - YOU CAN ADD MORE PIECES ES is famous for this. ^ & thus memory/CPU/etc. Its strength is the easy addition and coordination with new nodes. Your computations can scale as much RAM as a whole cluster, but the interface and commands you use remain as if it were just one node on your laptop.
USE IN PRODUCTION > Search (online shop front, admin tooling, recommendation systems, …) > Web app monitoring: “Logging, Metrics, Traces” > Now security too
USE IN PRODUCTION > Interactive dashboarding > Unsupervised learning (though this is paid) > Analytics (business metrics)
under the hood Apache Lucene ^ Elasticsearch is the glue
DEMO TIME! So far you’ve seen some in depth open source but this would be about as commercially successful and sustainable as Linux on the Desktop has been so far, without some eye catching stuff. Quick flash of what is possible.
MAYBE IT CAN’T HELP YOU FIND YOUR KEYS, BUT ALONG THE WAY, ELASTICSEARCH HAS HELPED PEOPLE DO: > Interplanetary research with JPL > JPL Curiosity Mars Rover and more > The search for food at Just Eat > Nuclear energy computing at Fermi Labs > Primary search at eBay > Playing with tech at Engadget > Tech DIY search at Instructables Elasticsearch has powered all kinds of search. From the analytics of the Mars rover, to allowing you to do your last minute Christmas shopping at John Lewis, Marks & Spencers & eBay, through finding an Uber on Christmas day when transport is out, to finding love on Tinder (or at least companionship). ^ The power of that technology is also in your hands, Elasticsearch being open source. ^ Links in this slide - will be posted in meetup group.
USEFUL LINUX USES AND OTHER RESOURCES > Monitoring Linux Command Execution with Auditbeat and Elastic Stack > Christmas tree lights with Micro:bit > “Awesome List” for Elasticsearch
THANK YOU! @emanuil_tolev etolev@elastic.co
Improving your engineering life with the Elastic Stack. A quick look at how other people have put the many free bells and whistles of the Elastic Stack to good use.
for free. You
can too.