Aeron: High-performance Transport for Low-latency Microservices

on YouTube ↗01h 12m

" summary

Aeron is a new transport library from Real Logic (built by Martin Thompson of Disruptor fame) designed for low-latency microservices and HFT-style performance. The talk explains where Aeron is applicable, how to use it in practice, and which implementation details and design choices produce its high throughput and low overhead.

AI-written summary · about

" chapters (31)

1. 0:00Introduction
2. 2:13Microservice performance issues
3. 5:22Cost savings and market race
4. 8:13Mechanical Sympathy and performance
5. 10:44First system implementation attempts
6. 13:14Message broker problems
7. 16:02Iron overview and benefits
8. 17:31Talk plan and Iron intro
9. 19:37Iron key features
10. 21:26Microservices and IPC
11. 23:15Iron API: publish and subscribe
12. 25:05Method offer signature bug
13. 26:30Iron reliability approach
14. 28:41Why offer returns void
15. 30:09Image and position handling
16. 33:38Subscription polling and hot loops
17. 36:33Why avoid select
18. 39:47Preventing partial reads
19. 41:13Fragment assembly
20. 44:03Media driver operation
21. 46:56Iron media driver agents
22. 48:42Media driver trading models
23. 50:07UDP and message ordering
24. 53:44Delivery guarantees and data gaps
25. 55:08IPC implementation
26. 56:12Multicast features
27. 57:17Final system architecture
28. 58:39Q&A on Iron
29. 1:00:29LogBuffer and admin actions
30. 1:04:26Talk summary and conclusion
31. 1:08:47Q&A and discussion

" related talks

• 15mAquila: A unified, low-latency fabric for datacenter networksDan Gibson, Arjun Singh, Amin Vahdat, Ming Tan, Hema Hariharan, Eric Lance, Moray McLaren, Behnam Montazeri, Stephen Wang, Zhehua Wu, Sunghwan Yoo, Raghuraman Balasubramanian, Prashant Chandra, Michael Cutforth, Peter Cuy, David Decotigny, Rakesh Gautam, Alex Iriza, Milo M. K. Martin, Rick Roy, Zuowei Shen, Ye Tang, Monica Wong-Chan, Joe Zbiciak, Hassan M. G. Wassel · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)
• 47mThe Making of an Ultra Low Latency Trading System with Go and JavaYucong Sun, Jonathan Ting · SREcon23 Americas
• 47mAdventures with Concurrent Programming in Java: A Quest for Predictable LatencyMartin Thompson · Code Mesh 2015
• 37mPanel Discussion: Ask Us Anything: Microservices and Service MeshLin Sun, William Morgan, Louis Ryan, Jason McGee, Zack Butcher · KubeCon + CloudNativeCon Europe 2019
• 36mPanel: Ask Me Anything: Microservices and Service Mesh [B]Jason McGee · KubeCon + CloudNativeCon North America 2017
• 49mNeed for ASYNC: in pursuit of scalable internet-scale applicationsKonrad 'ktoso' Malawski · Confitura 2015
• 24mGluing Clojure MicroservicesAlexander Fertman · Clojure/north 2020
• 42mRSocket - Future Reactive Application ProtocolOleh Dokuka · Spring I/O Bridge 2020