MuCache: A General Framework for Caching in Microservice Graphs
Talkat 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24) · 2024-04-16..04-18·
summary
MuCache is a framework that injects per-service cache managers and sidecar wrappers to serve hits locally without blocking requests, relying on a non-blocking cache coherence protocol whose correctness is proven via client-observable reordering. It plugs into existing stacks (uses Redis/Memcached and is implemented on top of Dapper), keeps cache coordination off the critical path, and in benchmarks shows up to 2.5× median latency reduction and up to 60% throughput increase while adding about 13% CPU overhead, 27% less network, and metadata below 30% of cache size.
AI-written summary · about
chapters (7)
- 0:00MuCache and microservices
- 2:22Microservices inefficiencies
- 4:31Cache coherence problem
- 5:34Client-centric coherence
- 9:24MuCache design
- 11:50Performance benefits
- 13:38Conclusion and open-source
related talks
47mArchitectural Patterns for Caching Microservices
53mLeveraging Caching For Cloud Native Applications
45mWhere is my cache? Architectural patterns for caching microservices by example
25mReactive Caching for Composed Services
32mCaching for Microservices - Introduction to Pivotal Cloud Cache - Pulkit Chandra
06mCan Microservices Drive a Renaissance in Workload-Aware Storage Management?
35mCaching at Netflix: The Hidden Microservice
43mCaching half a billion user transactions