Spring for Apache Kafka the advanced features

on YouTube ↗48m

" summary

Shows concrete Spring Kafka recipes: how non-blocking retries use retry topics and headers (configurable attempts, exponential backoff, eventual dead-letter), how to create runtime consumer components from config to handle multiple serialization formats, and how to scale vertically with the Kafka listener concurrency property. Demos run with Docker Compose, show metrics via Micrometer/Prometheus, traces in Grafana Tempo, logs to Loki, and cite ING production scale: ~2 million msgs/s, ~8,000 topics across clusters.

AI-written summary · about

" chapters (17)

1. 0:00Spring for Apache Kafka intro
2. 3:36Kafka overview
3. 6:48Why use Spring Kafka
4. 8:33Consumer groups and parallelism
5. 10:21Scaling consumers
6. 12:07Demo setup
7. 14:59Multiple serialization formats
8. 16:50Consumer runtime config
9. 22:16Vertical vs horizontal scaling
10. 25:12Demo vertical scaling
11. 26:58Consumer exception handling
12. 31:32Demo retries
13. 37:51Observability in events
14. 40:40Demo tracing and metrics
15. 43:32Demo tracing with Tempo
16. 45:24Demo Kafka metrics
17. 47:08Summary

" related talks

• 50mSpring Kafka beyond the basicsTim van Baarsen · J-Fall 2022
• 40mEvent Streaming Applications with Kafka Streams, Spring Kafka and ActuatorKo Turk · Voxxed Days Bucharest 2022
• 01h 44mData processing with Kafka Streams and Spring Framework.Dmitry Sergeev · Devoxx Ukraine 2020
• 51mData processing with Kafka Streams and Spring Framework. Dmitriy Sergeev. Java Fest 2020 OnlineDmitriy Sergeev · Java Fest 2020
• 50mStream processing with Kafka in Big Data environmentsEvgeniy Nenakhov · Joker 2023
• 53mSupersonic Subatomic Apache KafkaJakub Scholz · DevConf.CZ 2020
• 57mWhen Everything Went KafkaGrigoriy Koshelev · JPoint 2019
• 01h 11mBootiful Stream Processing!Viktor Gamov · Java Z-Day 2021