Composing high performance process workflows with Akka Streams

on YouTube ↗51m

" summary

Shows replacing hand-wired actors with Akka Streams to define workflows in C#, F# and Scala, using the Akka materializer to create actors behind the scenes; demonstrates a real indexer that streams persistent events into Elasticsearch/Kibana and a Twitter pipeline that reads cached tweets at thousands/sec, uses broadcast+merge, and proves buffering per branch allows different consumer rates — without buffers a 1 msg/s throttle slows the whole source to 1 msg/s; adds parallel HTTP calls (up to 5) to a weather API and uses a materializer that wires actors automatically, achieving the intended dashboard and tweet outputs.

AI-written summary · about

" chapters (10)

1. 0:00Akka Streams intro
2. 3:37Actors to workflows
3. 10:23First Scala exposure
4. 13:16Back pressure explained
5. 16:53Streams building blocks
6. 22:36Connectors for consuming
7. 24:48Event journal case study
8. 29:10Demo: streaming tweets
9. 42:25Key takeaways
10. 44:52Q&A

" related talks

• 58mLife with actors: experience reportVagif Abilov, Erlend Wiig · NDC London 2017
• 56mAkka in Heterogenous EnvironmentsJan Machacek · Code Mesh 2013
• 41mAkka in Production: Our StoryEvan Chan · Pacific Northwest Scala 2013
• 36mStream All The Things!Dean Wampler · Scale By the Bay 2017
• 59mDrinking a river of IoT data with Akka.NETHannes Lowette · NDC London 2020
• 47mStream All the Things!Dean Wampler · Scala.IO 2017
• 41mA tale of futures, actors & pipes: using Akka for large data migrationManuel Bernhardt · Scala.IO 2014
• 33mKafka Microservices with Kafka plus Akka and Kafka StreamsBoris Lublinsky · Scala Days Berlin 2018