Seer: Enabling Future-Aware Online Caching in Networked Systems
Talkat 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24) · 2024-04-16..04-18·
summary
Seer claims to shrink cache misses up to 65% and flow completion time up to 78% versus LRU by sending small state-index notifications ahead of packets and using them for prefetching and eviction, evaluated in a C packet-level simulator on a two-tier fat‑tree and on an FPGA prototype. It uses inter‑packet gap to send notifications with zero bandwidth overhead, splits cache into known/unknown future‑access sets for Belady‑like eviction, and implements the notifier in hardware by modifying the PCS sublayer on an FPGA.
AI-written summary · about
chapters (10)
- 0:00Seer introduction and motivation
- 2:06Current caching limits
- 3:29Research question and insights
- 5:15Network delays for future awareness
- 8:01Seer system design
- 11:14Zero-bandwidth notification protocol
- 11:34Future-aware cache manager
- 14:02FPGA hardware implementation
- 15:05Evaluation setup and traffic
- 16:53Future-aware caching benefits
related talks
23mFast Software Cache Design for Network Appliances
22mEffectively Prefetching Remote Memory with Leap
16mONCache: A Cache-Based Low-Overhead Container Overlay Network
19mFarReach: Write-back Caching in Programmable Switches
17mPushing the Limits of In-Network Caching for Key-Value Stores
16mPeeR: First-Class Scheduling for Latency-Critical eBPF Applications
25mResQ: Enabling SLOs in Network Function Virtualization
12mTwenty Years After: Hierarchical Core-Stateless Fair Queueing