Search Everything, Search Everywhere

A presentation at Google Cloud Developer Community Meetup in November 2019 in Mumbai, Maharashtra, India by Aravind Putrevu

Slide 1

Slide 1

Search <everywhere/> Search {everything} 1

Slide 2

Slide 2

Hello 2

Slide 3

Slide 3

Aravind Putrevu <Developer/> SIG-Contribex @aravindputrevu 3

Slide 4

Slide 4

Why I’m here? 4

Slide 5

Slide 5

5

Slide 6

Slide 6

6

Slide 7

Slide 7

7

Slide 8

Slide 8

8

Slide 9

Slide 9

9

Slide 10

Slide 10

But.. Search doesn’t stop there… 10

Slide 11

Slide 11

11

Slide 12

Slide 12

12

Slide 13

Slide 13

13

Slide 14

Slide 14

Slide 15

Slide 15

you know, for search

Slide 16

Slide 16

Elastic Stack SOLUTIONS Kibana Visualize & Manage Elasticsearch Store, Search, & Analyze Beats SaaS Elastic cloud Logstash On-Prem Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes Ingest

Slide 17

Slide 17

17

Slide 18

Slide 18

Elasticsearch Heart of the Elastic Stack 18 Distributed, Scalable High-availability Multi-tenancy Developer Friendly Real-time, Full-text Search Aggregations 1 8

Slide 19

Slide 19

github.com/elastic/elasticsearch 19

Slide 20

Slide 20

Terms Cluster A cluster is a collection of one or more nodes (servers) 20 https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

Slide 21

Slide 21

Terms Node A node is a single server that is part of your cluster, stores your data, and participates in the cluster’s indexing and search capabilities 21 https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

Slide 22

Slide 22

Terms Index An index is a collection of documents that have somewhat similar characteristics 22 https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

Slide 23

Slide 23

Terms Document JSON Document, which gets stored in Index 23 https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

Slide 24

Slide 24

Terms Shard Elasticsearch provides the ability to subdivide your index into multiple pieces called shards 24 https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

Slide 25

Slide 25

apps meta content Index 25

Slide 26

Slide 26

apps meta content Shards 26

Slide 27

Slide 27

Types of Shards Primary Shard Replica Shard ➢ Responsible for ➢ ➢ ➢ ➢ ○ ○ ○ Create Update Delete ➢ Pushes data to replica’s ➢ Important for write-heavy architecture 27 Helps with reads Fault tolerance Scalability Important for read-heavy or search architecture 27

Slide 28

Slide 28

28 28

Slide 29

Slide 29

29

Slide 30

Slide 30

30

Slide 31

Slide 31

Solutions Site Search App Search Logs Metrics SIEM 31 Enterprise Search Tracing ENDPOINT

Slide 32

Slide 32

Deploying Search… 32

Slide 33

Slide 33

Ways to create Elasticsearch Cluster? Self-managed 33 Cloud Infra Managed Service

Slide 34

Slide 34

34

Slide 35

Slide 35

$> docker pull elasticsearch 35 Images: docker.elastic.co

Slide 36

Slide 36

36

Slide 37

Slide 37

Running Elasticsearch on GCP 37 1 2 3 4 5 Login to GCP Console Go to GCP Marketplace Search “Elasticsearch Service on Elastic Cloud” Purchase & Enable Manage via Elastic

Slide 38

Slide 38

Running Elasticsearch on GCP 38 1 2 3 4 5 Login to GCP Console Go to GCP Marketplace Search “Elasticsearch Service on Elastic Cloud” Purchase & Enable Manage via Elastic

Slide 39

Slide 39

Running Elasticsearch on GCP 39 1 2 3 4 5 Login to GCP Console Go to GCP Marketplace Search “Elasticsearch Service on Elastic Cloud” Purchase & Enable Manage via Elastic

Slide 40

Slide 40

Running Elasticsearch on GCP 40 1 2 3 4 5 Login to GCP Console Go to GCP Marketplace Search “Elasticsearch Service on Elastic Cloud” Purchase & Enable Manage via Elastic

Slide 41

Slide 41

Running Elasticsearch on GCP 41 1 2 3 4 5 Login to GCP Console Go to GCP Marketplace Search “Elasticsearch Service on Elastic Cloud” Purchase & Enable Manage via Elastic

Slide 42

Slide 42

42

Slide 43

Slide 43

43

Slide 44

Slide 44

Searching with Elastic Enterprise Search 44

Slide 45

Slide 45

Managing and Connection Sources with Elastic Enterprise Search 45

Slide 46

Slide 46

Resources ela.st/search 46 46

Slide 47

Slide 47

Resources ela.st/community-trial 47 47

Slide 48

Slide 48

Fin! discuss.elastic.co | aravind@elastic.co | @aravindputrevu 48