A presentation at LJC Virtual Meetup by Robin Moffatt
You’ve got streams of data that you want to process and store? You’ve got events from which you’d like to derive state or build aggregates? And you want to do all of this in a scalable and fault-tolerant manner? It’s just as well that Kafka and ksqlDB exist!
This talk will be built around a live demonstration of the concepts and capabilities of ksqlDB. We’ll see how you can apply transformations to a stream of events from one Kafka topic to another. We’ll use ksqlDB connectors to bring in data from other systems and use this to join and enrich streams—and we’ll serve the results up directly to an application, without even needing an external data store.
Attendees will learn:
The following resources were mentioned during the presentation or are useful additional information.
Try out the ksqlDB demo for yourself - all you need is Docker and Docker Compose.
A fun blog showing what you can do with ksqlDB and Kafka
Tutorials, videos, blogs, podcasts, and more - all for developers working with Apache Kafka and Confluent Platform
Huge list of connectors for Kafka Connect
Fully Managed Apache Kafka, Schema Registry, KSQL, and Connectors
Free eBooks to download, including Kafka: The Definitive Guide.
Learn all about Kafka Connect (including the connectors available with ksqlDB)
Here’s what was said about this presentation on Twitter.