Stateful & Reactive Stream Processing Applications Without a Database

on YouTube ↗51m

" summary

Builds a live emoji tracker using Apache Kafka, a Kafka Connect Twitter source, and Kafka Streams to extract, flatMap, group and maintain KTables (state stores in-memory or RocksDB) with changelog topics for rebuild. Exposes interactive queries and a reactive WebAPI on Spring Boot 2.0 (Mono/Flux) and pushes updates to the browser as server-sent events via reactor-kafka; demo shows live counters updating (example reached ~67) with no external database required.

AI-written summary · about

" chapters (14)

1. 0:00Introduction
2. 3:53Streaming platforms and Kafka
3. 8:46Kafka APIs overview
4. 13:21Kafka Streams and ksqlDB
5. 17:40Emoji tracking app intro
6. 19:23Data ingestion with Kafka Connect
7. 23:38Stream processing with Kafka Streams
8. 29:00Interactive queries layer
9. 36:11State changes with changelog topics
10. 42:14Live emoji tracking demo
11. 42:54Q&A: State persistence
12. 47:05Q&A: Security and connectors
13. 48:11Q&A: Fault tolerance
14. 49:56Q&A: Changelog topics

" related talks

• 47mSpring Boot 2.0 Web ApplicationsStéphane Nicoll, Brian Clozel · Spring I/O 2018
• 02h 45mReactive RevolutionJosh Long · Devoxx Belgium 2019
• 50mGoing reactive with Spring DataChristoph Strobl · JavaDay Ukraine 2017
• 43mEvent streaming applications with Kafka Streams, Spring Kafka and ActuatorKo Turk · JNation 2022
• 51mReactive SpringJosh Long · GeeCON 2019
• 52mStream Processing with the Spring Framework Like You’ve Never Seen It BeforeJosh Long, Viktor Gamov · Spring I/O 2019
• 51mSpring Boot 2 0 Web ApplicationsStéphane Nicoll, Brian Clozel · Devoxx Belgium 2017
• 54mFull-stack Reactive Kotlin with Project Reactor & Spring Boot 2Mark Heckler · Riga Dev Days 2019