Building Event Driven Services with Apache Kafka and Kafka Streams

on YouTube ↗53m

" summary

Explains how Apache Kafka plus Kafka Streams turn event streams into local state and scalable services, using CDC connectors, Avro schema registry and Kafka transactions to keep updates atomic. Shows a working microservices demo that journals orders, replicates customer and stock data into local views, and joins streams with a five-minute tumbling window to flag fraud where count > 3. Claims platform handles massive ingest like 100 terabytes a day, supports rewind/replay and compaction, and the example code runs.

AI-written summary · about

" chapters (11)

1. 0:00Start
2. 3:36Streaming Platforms
3. 11:25Problem with Service Architectures
4. 15:11Event Driven Model
5. 22:26Ordering Guarantee
6. 25:43Compacted Log
7. 26:17Connectors
8. 27:06Change Data Capture
9. 29:25Windows and Retention
10. 37:46Schema Registry
11. 39:18Schema Migration

" related talks

• 35mBuilding a Real-time Streaming Platform Using Kafka Streams...Jay Kreps · Data By the Bay 2016
• 41mApache Kafka simply explainedOlena Kutsenko · Berlin Buzzwords 2022
• 50mIntroduction to Apache KafkaJames Ward · Devoxx US 2017
• 33mKafka Microservices with Kafka plus Akka and Kafka StreamsBoris Lublinsky · Scala Days Berlin 2018
• 27mKeynote II: Kafka and the Rise of Event-Driven MicroservicesNeha Narkehede · Scale By The Bay 2018
• 30mEvent Streaming and the Future of ApplicationsBen Stopford · JAX 2019
• 55mDemystifying Stream Processing with Apache KafkaEwen Cheslack-Postava · Philly ETE 2016
• 01h 31mDeveloping Real-Time Data Pipelines with Apache KafkaJoe Stein · SpringOne2GX 2015