Scalable Rule Management for Data Centers

on YouTube ↗22m

" summary

A system called vCRIB automates rule placement across hypervisors and switches using a two-step pipeline: a resource-aware feasible-placement (a firstfit-decreasing-similarity algorithm that packs similar partitions) followed by a traffic-aware refinement (a benefit-greedy migration). Evaluated on a 1,000-server simulation with 200k flows, it finds feasible placements when source-only placement would exceed host capacity and often keeps extra forwarding under <10% traffic overhead, extending operational range of data centers.

AI-written summary · about

" chapters (10)

1. 0:00Intro
2. 0:16Introduction: Definitions
3. 1:38Current practice
4. 1:51Machines have limited resources
5. 4:05Challenges: Concrete example
6. 6:02Contribution: VCRIB, a Virtual Cloud Rule Information Base Proactive rule placement abstraction layer
7. 6:59Partitioning with replication
8. 10:39Traffic-aware refinement Overhead greedy approach
9. 12:29VCRIB design: Dynamics
10. 16:05Parameter sensitivity analysis: Rules in partitions

" related talks

• 16mFlow Scheduling with Imprecise KnowledgeKai Chen, Guyue Liu, Wenxin Li, Xin He, Yuan Liu, Keqiu Li, Zhao Ge, Zewei Guan, Heng Qi, Song Zhang · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 14mRDC: Energy-Efficient Data Center Network Congestion Relief with TopologicalWeitao Wang, T. S. Eugene Ng, Ang Chen, Dingming Wu, Sushovan Das, Afsaneh Rahbar · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)
• 25mResQ: Enabling SLOs in Network Function VirtualizationScott Shenker, Sylvia Ratnasamy, Aurojit Panda, Katerina Argyraki, Chang Lan, Amin Tootoonchian, Melvin Walls · NSDI '18
• 15mMitigating Scalability Walls of RDMA-based Container NetworksEnnan Zhai, Tianyin Xu, Wei Liu, Feng Qian, Yunhao Liu, Yu Guan, Kun Qian, Zhenhua Li, Lanlan Xi, Shuhong Zhu, Hongfei Xu, Chao Qin · NSDI '25
• 25mVirtualizing Traffic Shapers for Practical Resource AllocationGautam Kumar, Srikanth Kandula, Ishai Menache, Peter Bodik · HotCloud '13
• 17mPrecise Data Center Traffic Engineering with Constrained Hardware ResourcesRui Wang, Srinivasan Seshan, Peter Steenkiste, Keqiang He, Shawn Shuoshuo Chen · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 20mContra: A Programmable System for Performance aware RoutingDavid Walker, Ryan Beckett, Kuo-Feng Hsu, Ang Chen, Jennifer Rexford, Praveen Tammana · NSDI 2020
• 23mMinimal Rewiring: Efficient Live Expansion for Clos Data Center NetworksRui Wang, Amin Vahdat, Joon Ong, Shizhen Zhao, Jeffrey C. Mogul, Junlan Zhou · NSDI 2019