Mailing Adventures with PostgreSQL: Taming 650+ Shards and Surviving
summary
A presentation about a PostgreSQL-based sharding service used for mail at Yandex: it explains why they built the sharding service, how the central metadata store and individual shards are structured, and which techniques they use to minimize access latency to the metadata. The talk also covers the service’s historical evolution, optimizations made after migrating to the cloud, and the benefits this sharding approach provides to multiple Yandex 360 services.
AI-written summary · about
chapters (7)
- 0:00Sharding journey intro
- 5:50Why dynamic sharding
- 10:04Hardware-based setup
- 15:22Cloud migration
- 22:25Cloud challenges
- 28:11Final solution
- 33:31Q&A
related talks
49mSharding: from scratch to Yandex Disk
53mBreakout Session
45mThe Future of Postgres Sharding
50mHow PG Sharding Works in Yandex Taxi’s Processing
45mThe Future of Postgres Sharding
31mPostgreSQL Distributed & Secure Database Ecosystem Building
33mFive Sharding Data Models and Which is Right
42mPostgreSQL Distributed & Secure Database Ecosystem Building