Precise Data Center Traffic Engineering with Constrained Hardware Resources

on YouTube ↗17m

" summary

System adapts switch memory allocation to flow volume and precision loss, prunes select ports and merges identical weight distributions to implement TE on constrained hardware. Two reduction algorithms are implemented: a mixed integer solver and a greedy search that apply group sharing, table carving, and table pruning to fit groups into limited entries. Evaluation on realistic traces shows TE is approximated within 7% error versus 67% for prior table fitting, avoids rule overflow, and runs about 10× faster.

AI-written summary · about

" chapters (11)

1. 0:00Introduction
2. 2:04How TE works
3. 3:47Limited switch memory
4. 5:33Precision loss effects
5. 7:43Root causes of precision loss
6. 10:09Limitations of group reduction
7. 11:52New heuristics for group reduction
8. 12:14DMIR and IGR algorithms
9. 13:58Evaluation: link utilization & flow completion
10. 15:22Performance speed & comparison
11. 16:29Summary

" related talks

• 25mVirtualizing Traffic Shapers for Practical Resource AllocationGautam Kumar, Srikanth Kandula, Ishai Menache, Peter Bodik · HotCloud '13
• 17mTraffic Engineering for AI Training NetworksShuqiang Zhang, Jingyi Yang · Networking @Scale 2023
• 17mDOTE: Rethinking (Predictive) WAN Traffic EngineeringChaim Hoch, Srikanth Kandula, Yarin Perry, Felipe Vieira Frujeri, Ishai Menache, Michael Schapira, Aviv Tamar · NSDI 2023
• 16mSöze: One Network Telemetry Is All You Need for Per-flow Weighted Bandwidth Allocation...Weitao Wang, T. S. Eugene Ng · OSDI '25
• 22mAdapting TCP for Reconfigurable Datacenter NetworksSrinivasan Seshan, Daehyeok Kim, Alex C. Snoeren, Weiyang Wang, Matthew K. Mukerjee, Christopher Canel · NSDI 2020
• 21mSemi-Oblivious Traffic Engineering: The Road Not TakenPraveen Kumar, Petr Lapukhov, Robert Soulé, Nate Foster, Robert Kleinberg, Chiun Lin Lim, Yang Yuan, Chris Yu · NSDI '18
• 17mNetHint: White-Box Networking for Multi-Tenant Data CentersWei Zhang, Ion Stoica, Jingrong Chen, Danyang Zhuo, Hong Zhang, Liang Luo, Jeffrey Chase · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)
• 16mPowerTCP: Pushing the Performance Limits of Datacenter NetworksStefan Schmid, Vamsi Addanki, Oliver Michel · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)