Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK

A presentation at Kubernetes Barcelona Meetup in November 2019 in Barcelona, Spain by Imma Valls

Slide 1

Slide 1

Deploying Elasticsearch & Kibana to Kubernetes with the Elastic operator Janko Strassburg - Sr. Support Engineer @jankopueh Imma Valls - Sr. Support Engineer @eyeveebee 1

Slide 2

Slide 2

Typical Adoption of the Elastic Stack … Single cluster Multiple use cases Single cluster Use case grows Single cluster Single use case 1 2 More data 2 More use cases 3

Slide 3

Slide 3

Managing one big cluster has challenges Single cluster Multiple use cases 3 • Managing Differences • Isolating tenants • True fair use is impossible

Slide 4

Slide 4

Time to split! 4

Slide 5

Slide 5

Typical Adoption of the Elastic Stack … Single cluster Multiple use cases Single cluster Single use case 1 5 Many teams, many projects, multiple clusters and use cases Single cluster Use case grows More data 2 More use cases 3 More of everything 4

Slide 6

Slide 6

Elastic Cloud on Kubernetes (ECK) Beta release October 14th ● New product that allows customers to orchestrate Elasticsearch, Kibana, APM Server on Kubernetes ● Extends native Kubernetes API using the Operator pattern ● Open code https://github.com/elastic/cloud-on-k8s ● Also available at https://operatorhub.io/operator/elastic-cloud-eck 6

Slide 7

Slide 7

What is a Kubernetes Operator ● A way to deliver a Kubernetes Native Application ● Encode operational logic ○ 7 E.g. “I know how to upgrade Elasticsearch properly”

Slide 8

Slide 8

Elastic Cloud on Kubernetes ● Multi-cluster deployment and management ● Automatic security configuration ● Snapshot scheduling and keystore support ● Faster recovery from failures ● Local persistent storage by Elastic ● Advanced topology ○ master, ingest, ml, hot-warm cold

Slide 9

Slide 9

Demo https://ela.st/bcn-k8s-meetup-2019-11-14 9

Slide 10

Slide 10

Next steps ● Sample configuration on Github https://github.com/elastic/cloud-on-k8s/tree/master/config/samples ● Launching blog https://www.elastic.co/blog/introducing-elastic-cloud-on-kubernetes-theelasticsearch-operator-and-beyond ● Documentation https://www.elastic.co/es/products/elastic-cloud-kubernetes ● Operator at OperatorHub.io https://operatorhub.io/operator/elastic-cloud-eck ● Discuss forums https://discuss.elastic.co/c/eck 10

Slide 11

Slide 11

Thanks! https://ela.st/bcn-k8s-meetup-2019-11-14 11