SLATE: Intelligent Request Routing

on YouTube ↗22m

" summary

SLATE is a Service‑Layer Traffic Engineering system that globally optimizes request routing using telemetry from an Envoy WASM plugin, cluster controllers and a global controller that runs a linear regression load→latency model and a linear‑programming optimizer. It trades off latency versus egress cost with an admin intent metric like dollars per millisecond, prioritizes request classes, and in a demo shifts traffic across two clusters to cut average latency from ~300 ms to 52 ms avg / 176 ms tail.

AI-written summary · about

" chapters (16)

1. 0:00SLATE project intro
2. 1:23Routing challenges in Microsoft apps
3. 2:49Cross-cluster routing gaps
4. 4:14Traffic management limitations
5. 4:56SLATE design from traffic engineering
6. 5:37SLATE architecture and data flow
7. 7:44Latency optimization under load
8. 9:50Comparison with baseline routing
9. 10:33Dollar per millisecond metric
10. 11:36Minimizing egress costs
11. 13:22Handling request classes
12. 14:24Challenges and future plans
13. 15:05Demo: latency optimization
14. 18:37Q&A: control flow and API
15. 19:59Q&A: local vs global decisions
16. 20:43Q&A: DNS and high availability

" related talks

• 25mResQ: Enabling SLOs in Network Function VirtualizationScott Shenker, Sylvia Ratnasamy, Aurojit Panda, Katerina Argyraki, Chang Lan, Amin Tootoonchian, Melvin Walls · NSDI '18
• 16mExpress Lane to Efficiency and Reliability: Multi-Dimensional Control in Meta’s Express..Ying Zhang, Rong Rong, Aditya Akella, Qin Zhang, Faisal Iqbal, Vitaly Neganov, Brian Chang, Yuanjun Yao, Marek Denis, Alexandru Manea, Anton Marchenko, Ulas Kozat · NSDI '26
• 29mSpanning the Globe with Envoy at StripeDylan Carney · EnvoyCon 2019
• 35mIntelligent Load Balancing in KubernetesGaurav Nanda, Vincent Cheng · SREcon26 Americas
• 37mLevel Up Your Edge: Do You Know Where Your Traffic Comes From?Radha Kumari · SREcon25 Europe/Middle East/Africa
• 19mDecentralized cloud wide-area network traffic engineering with BLASTSHIELDUmesh Krishnaswamy, Nikolaj Bjørner, Rachee Singh, Himanshu Raj · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)
• 23mNetwork SLOs: Knowing When The Network Is The Barrier To Application Quality Of ExperienceBrandon Schlinker, Sharad Jaiswal · Networking @Scale Fall 2022
• 21mR2P2: Making RPCs first-class datacenter citizensAdrien Ghosn, Marios Kogias, Edouard Bugnion, George Prekas, Jonas Fietz · USENIX ATC '19