Developing a stream processing application with Apache Kafka and Quarkus
summary
Shows a working Quarkus + MicroProfile Reactive Messaging integration with Apache Kafka, including live-coded reactive coffee shop demo that produces orders and a dashboard topic, and a separate consumer service that processes them. Uses the Redpanda dev service for local Kafka, demonstrates emitters, channel-to-topic mapping, and offset tracking and ack-based commits to avoid duplicates. Covers poison-pill handling (DLQ vs fail), pause/resume backpressure with Kafka, and OpenShift autoscaling that spawns multiple consumer pods (three observed) and tears them down after processing.
AI-written summary · about
chapters (9)
- 0:00Introduction and speaker intro
- 1:19From monoliths to distributed systems
- 9:49Quarkus for cloud-native Java
- 17:36Reactive vs imperative execution
- 22:50Kafka fundamentals and challenges
- 33:27Reactive Messaging with Quarkus
- 41:13Live demo: Coffee shop app
- 50:01Deployment and auto-scaling demo
- 52:08Conclusion and resources
related talks
50mBuilding reactive microservices with MicroProfile
02h 51mReactive Microservices with Quarkus
50mWhen Quarkus Meets MicroProfile
49mServerless Java on Knative with Quarkus
28mReactive Quarkus
45mProcessing 1m msgs/CPU/GB of memory with Quarkus and MicroProfile ...
47mProd like Integration Testing for Cloud Native Microservices
31mEvent driven communication with Kafka on Kubernetes