Caching Entire Systems without Invalidation
summary
Argues systems become cacheable by resolving all variable inputs up front and splitting into a state gathering layer and an immutable zone so downstream functions always see fixed values. Shows a concrete days‑old example, then two patterns for big datasets: the timestamped data pattern (index with timestamps + immutable document store) and a snapshot service; Bloomberg uses the append‑only document pattern for a mortgage‑backed analytics pipeline and reports it works, with cache keys including service versions.
AI-written summary · about
chapters (15)
- 0:00Introduction to architecture
- 1:41The role of SRE
- 3:31Defining statelessness
- 5:57Caching benefits
- 7:11Hard problems in caching
- 10:33Interface design for caching
- 13:45Resilient cache behavior
- 15:36Key takeaways
- 17:05Handling large databases
- 18:59Timestamp data pattern
- 21:15Object store pattern
- 22:19Snapshot data pattern
- 25:23Benefits of timestamp data
- 27:11Managing software versions
- 28:52Conclusion and Q&A
related talks
31mApplication Cache: Douchebag
28mNever Wait for an API Again: Unlocking CacheStorage for Blazing Speed
31mThe Opposite of Spaghetti Code: Building for Understanding
34mImmutability: Putting The Dream Machine To Work
49mReactive microsystems
01h 06mPatterns of Basecamp's Application Architecture
28mPersistent data structures - good for UI
32mThere and Back Again: Grokking State and Data
