PolicyCache: Intra-flow Learning in Congestion Control

on YouTube ↗14m

" summary

PolicyCache claims intra‑flow learning that trains and runs a nonparametric Hoeffding Adaptive Tree (HAT) inside each flow, plus backup exploration and micro exploration for safe labeling and continual updates. A Linux prototype and convergence proof back the claim. Evaluations report faster convergence than pure exploration, consistently high throughput and low latency across emulated and intercontinental links, fair sharing across RTTs, balanced coexistence with cubic and BBR, and CPU overhead much lower than NN CC and comparable to heuristic schemes.

AI-written summary · about

" chapters (13)

1. 0:00Introduction
2. 1:21Limitations of congestion control
3. 2:46Intra-flow learning concept
4. 4:14Non-parametric models for fast adaptation
5. 4:56PolicyCache system design
6. 6:21Hoeffding Adaptive Tree
7. 7:23Exploration mechanisms
8. 8:06Data collection and scoring
9. 9:07Implementation details
10. 9:52Evaluation results
11. 10:57Fairness and overhead analysis
12. 12:02Dynamic switching
13. 13:04Conclusion

" related talks

• 23mFast Software Cache Design for Network AppliancesHuacheng Yu, Dong Zhou, Michael Kaminsky, David G. Andersen · USENIX ATC '20
• 16mONCache: A Cache-Based Low-Overhead Container Overlay NetworkPeirui Cao, Shizhen Zhao, Xinbing Wang, Shengkai Lin, Xinchi Han, Quan Tian, Wenfeng Liu, Qi Wu, Donghai Han · NSDI '25
• 16mBackpressure Flow ControlKevin Zhao, Thomas E. Anderson, Mohammad Alizadeh, Georgios Nikolaidis, Prateesh Goyal, Preey Shah · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)
• 25mPCC Vivace: Online-Learning Congestion ControlDoron Zarchy, Mo Dong, Brighten Godfrey, Yossi Gilad, Michael Schapira, Tong Meng, Engin Arslan · NSDI '18
• 13mAUTO: Adaptive Congestion Control Based on Multi-Objective Reinforcement Learning...Long Chen, Xu Li, Feilong Tang, Jiacheng Liu, Laurence T. Yang, Luoyi Fu · USENIX ATC '21
• 17mPyrrha: Congestion-Root-Based Flow Control to Eliminate Head-of-Line Blocking in...Wei Chen, Stefan Schmid, Fei Chen, Xiaoliang Wang, Guihai Chen, Chen Tian, Vamsi Addanki, Jiaqi Zheng, Wanchun Dou, Bingyang Liu, Zhaochen Zhang, Kexin Liu, Chang Liu, Yizhi Wang, Qingyue Wang, Wenhao Sun, Tao Wu, Ke Meng, Weiguang Wang · NSDI '25
• 19mLearning Production-Optimized Congestion Control Selection for Alibaba Cloud CDNXu Chen, Ennan Zhai, Haoran Xu, Chen Chen, Guihai Chen, Xumiao Zhang, Xuan Zeng, Xiaoxi Zhang, Yubing Qiu, Yiping Zhang, Chong Hao · NSDI '25
• 17mTowards provably performant congestion controlRuben Martins, Anup Agarwal, Srinivasan Seshan, Venkat Arun, Devdeep Ray · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)