Streaming data with Kafka and Akka

on YouTube ↗47m

" summary

Discusses how Simacan handles very large streams of vehicle location and road-speed updates to compute real-time expected arrival times using Apache Kafka, Akka Actors and Akka Streams. Presents a hands-on platform implementation with demos showing practical do’s and don’ts learned while building the streaming pipeline rather than abstract architecture diagrams.

AI-written summary · about

" chapters (19)

1. 0:00Introduction
2. 1:10Demo concept
3. 3:20Akka and Kafka
4. 7:41Producer and REST endpoint
5. 8:46Kafka Streams sources
6. 10:32Consumers and serialization
7. 12:18Actors and state
8. 15:09Consumer integration
9. 17:18Kafka tools examples
10. 18:46Consistency and reliability
11. 20:32Parallel processing backpressure
12. 22:56Testing big data
13. 24:25Filter service
14. 27:12Backpressure Akka Streams
15. 30:56Akka Streams actors
16. 33:49Actor mailbox backpressure
17. 34:55Data enrichment
18. 36:01Q&A
19. 46:01Summary