STREAM DRIVEN DEVELOPMENT - DESIGN YOUR DATA PIPELINE WITH AKKA STREAMS

on YouTube ↗31m

" summary

Builds a production Akka Streams pipeline that reads property-change events from Reactive Kafka, validates and transforms them into AdWords updates, and calls Google via an async HTTP sink using mapAsync(parallelism) to control concurrency. Errors and audit metadata flow as explicit Either events and get routed to a separate sink via divertToMat (available since Akka 2.5.10). Materialized values surface a completion Future (or control knobs) so the runnable graph can be monitored and shut down; the approach is pragmatic and used in production.

AI-written summary · about

" chapters (8)

1. 0:00Start
2. 4:11EXAMPLE
3. 5:47STAGE ARITHMETIC
4. 8:26STAGE SIGNATURE
5. 17:59SOURCE - REACTIVE KAFKA
6. 19:52PROCESSING FLOW
7. 22:13STORING FLOW
8. 25:30GRAPH - DIVERT ERRORS

" related talks

• 48mStreaming all the things with Akka StreamsJohan Andrén · Voxxed Days Zurich 2017
• 46mTame Your Data with Akka StreamsJacek Kunicki · Scale By the Bay 2017
• 01h 20mAkka Streams for Large Scale Data ProcessingZack Loebel-Begelman, Dustin Lyons · Data By the Bay 2016
• 30mLive Coding: Building Stateful and Scalable Reactive Streams...Nolan Grace · Scale By the Bay 2021
• 33mKafka Microservices with Kafka plus Akka and Kafka StreamsBoris Lublinsky · Scala Days Berlin 2018
• 41mThe Promise of Event Driven Programming with Fast DataDuncan K. DeVore · Scala Days New York 2018
• 54mHow I Learned to Stop Worrying & Love the FlowViktor Klang · GOTO Copenhagen 2014
• 53mBuilding Event Driven Services with Apache Kafka and Kafka StreamsBen Stopford · Devoxx Belgium 2017