Stream Processing at Scale with Spring XD and Kafka

on YouTube ↗01h 29m

" summary

Shows a working pipeline that pairs Spring XD / Spring Cloud Stream with Apache Kafka and RxJava to process sensor JSON, partitioned by sensor ID so odd/even sensors land on different instances. Demonstrates programmatic offset management and manual acks via Spring Integration Kafka, uses Kafka topics as hops between modules, scales modules to multiple instances on Lattice/Cloud Foundry, and implements partitioned streams plus RxJava time windows to compute rolling averages and a top-3 sensor ranking; the demo runs and proves ordering and partitioning.

AI-written summary · about

" chapters (12)

1. 0:00Introduction
2. 2:16Stream processing concepts
3. 5:54Kafka overview
4. 11:31Kafka for stream processing
5. 15:42Spring integration Kafka
6. 26:05Kafka integration demo
7. 30:10Spring XD overview
8. 35:38Spring XD and Kafka
9. 43:36Advanced XD demo
10. 1:00:34Evolution to Cloud Data Flow
11. 1:07:51Cloud Data Flow and Kafka
12. 1:17:26Lattice deployment demo