Millions of Tiny Databases
summary
Physalia is a transactional key-value store built as millions of tiny replicated state machines that each act as the configuration master for a single EBS volume; each cell offers strict serializable transactions and keeps metadata typically under 1 MB so replica transfer and repair are fast. Placement uses a numerical optimizer across a data center (~30 MW scale) to minimize blast radius while keeping cross-rack redundancy (common deployment uses seven copies), and a cell failure makes that volume unavailable but is engineered to be an extremely rare event.
AI-written summary · about
chapters (6)
- 0:00Start
- 0:24Table of contents
- 0:53Simplified Storage System
- 12:37Topology Details Matter
- 14:06Take Advantage of Eventual Consistency When You Can
- 15:04Optimize for Blast Radius
related talks
42mScaling Resilient Systems: A Journey into Slack's Database Service
45mVitess: Stateless Storage in the Cloud
32mOperating A Multi Petabyte System Of Record For Billions Of Users
25mHybrid Memory Aerospike @ PayPal
24mWhat a Modern Database Enables
30mOvercoming Distributed Databases Scaling Challenges with Tablets
50mRunning Databases Efficiently at Scale - Case Study of Flipka...
24mgives databases to everyone