Event Streaming with Apache Kafka & MongoDB

Hans-Peter Grahsl • working & living in Graz • technical trainer @ NETCONOMY • engineer / consultant / speaker • original sink connector author • Confluent Community Catalyst @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 2

Event Streaming is on the rise… @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 3

Diminishing Value of Data @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 4

Events @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 5

events… …events everywhere! @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 6

Streaming @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 7

“… data processing that is designed with infinite data sets in mind.” — Tyler Akidau @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 8

☞ messaging ☞ integration ☞ processing plus storage @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 9

@hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 10

Operational Data Store ? @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 11

Operational Data Store ? @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 12

Operational data stores provide… ☞ richer data models ☞ arbitrary CRUD + convenient aggregations ☞ powerful secondary indexes ☞ fast + flexible analytics ☞ direct end-user serving @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 13

Why Apache Kafka and MongoDB ? @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 14

Apache Kafka + MongoDB = ✓ scalability & high availability ✓ embrace data in motion ✓ data retention support ✓ seamless cold storage integration ✓ fully managed cloud offerings @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 15

Kafka Connectors @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 16

Source Connectors @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 17

Sink Connectors @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 18

@hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 19

@hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 20

Exemplary Use Cases @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 21

Single Customer View @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 22

Synchronization across Services @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 23

Real-Time Recommendations @hpgrahsl | #MongoDB DACH #Community, 22nd October 2020, Virtual 24

reach out to me @hpgrahsl

!!! slides are here https://bit.ly/35kplwp