Drinking a river of IoT data with Akka NET

on YouTube ↗01h 01m

" summary

Claims Akka.NET scales IoT ingestion to very large fleets using the actor model, with 2 million messages on a laptop versus Petabridge’s 50 million messages claim. Implementation uses Akka.Remote for cross-node actor references, Akka.Persistence for event‑sourced device state, an App Service as a pausable ingestion buffer, and a parent/proxy pattern that spawns per‑device actors plus a hot/cold storage split (working set in memory, cold SQL for long history). Deploys require pausing ingestion, draining inboxes, and automated restart/sharding to avoid bottlenecks.

AI-written summary · about

" chapters (19)

1. 0:00Start
2. 2:30Erlang
3. 8:03Actor Model
4. 10:23Immutable Messages
5. 10:57Actor System
6. 11:51Create an Actor System
7. 23:02Thresholds and Alerts
8. 28:20Normalizing Data
9. 29:26Clock Drift
10. 31:42Gap Filling
11. 34:36The Parent Proxy Pattern
12. 37:03Location Transparency
13. 40:04Actor Selection
14. 41:35Switchable Behaviors
15. 47:30A Persistent Actor
16. 48:18Receive Persistent Actor
17. 56:44Dependency Injection
18. 58:35Deployment
19. 59:41Conclusion

" related talks

• 48mProcess IoT information using Akka.NETAarjan Meirink · Build Stuff 2017
• 01h 14mAkka.NET: The Future of Distributed Programming in .NETAaron Stannard · NDC Sydney 2016
• 44mDeath to Latency: Building Reactive, Cloud Native Apps with Akka NETAaron Stannard · Build Stuff 2022
• 47mNetworks and Types — the Future of AkkaKonrad 'ktoso' Malawski · Scala Days New York 2018
• 48mStreaming all the things with Akka StreamsJohan Andrén · Voxxed Days Zurich 2017
• 01h 20mAkka Streams for Large Scale Data ProcessingZack Loebel-Begelman, Dustin Lyons · Data By the Bay 2016
• 37mAkka Present and FutureChristopher Batey · Scala Days Berlin 2018
• 48mReliable messaging in the world of actorsVagif Abilov · KanDDDinsky 2022