Introducing Kafka Streams, new stream processing library ...
summary
Kafka Streams is a native Java library that runs as part of Kafka (released with Kafka 0.10), not a separate cluster: you scale by launching identical app instances and Kafka rebalances work. It gives millisecond latency (no microbatches), log‑compacted state stores that replicate state to Kafka for failover, supports event‑time semantics, windowed aggregations and joins, currently offers at‑least‑once processing and is working toward exactly‑once and queriable state.
AI-written summary · about
chapters (18)
- 0:00Introduction and welcome
- 1:31Apache Kafka overview
- 3:13Stream processing challenges
- 5:18What is Kafka Streams
- 6:00Kafka Streams in infrastructure
- 7:30When to use Kafka Streams
- 9:17Key features and benefits
- 12:04Underlying Kafka concepts
- 13:53Streams and tables relationship
- 16:40Kafka Streams DSL example
- 18:47Key features of Kafka Streams
- 21:36Stateful computations
- 23:04Time semantics and windowing
- 26:36Handling late data
- 27:37Processing guarantees
- 28:21Getting started with Kafka Streams
- 29:27Future developments
- 31:27Q&A session
related talks
45mApplications in the Emerging World of Stream Processing
03mInterview
55mDemystifying Stream Processing with Apache Kafka
01h 29mEvent stream processing using Kafka Streams
16mAn introduction to Apache Kafka - this is Event Streaming, not just Messaging
03h 00mStream Processing, Going Beyond Pub/Sub with Kafka Streams and...
01h 00mIn Depth Kafka Streams
27mNavigating Streaming Infrastructure