Distributed Postgres with Citus

on YouTube ↗44m

" summary

Citus turns Postgres into a sharded, multi node database by adding a Citus extension to standard Postgres servers and a coordinator that rewrites queries into per shard SQL. It shards by a hash of the shard key, runs aggregates in parallel, and uses two‑phase commit for distributed transactions plus a cluster wide deadlock detector. Backup and recovery use WAL shipping with wal‑e / wal‑g and shards can be rebalanced to add capacity or enable masterless coordinators ; cloud failovers take about 30s–60s.

AI-written summary · about

" chapters (14)

1. 0:00Introduction to speaker
2. 0:37Why Postgres is popular
3. 1:44Scaling challenges
4. 3:01Citus architecture overview
5. 5:01Citus internals and sharding
6. 7:22Scaling SQL complexities
7. 8:07Postgres replication methods
8. 12:58Disaster recovery techniques
9. 15:40Distributing PostgreSQL
10. 18:04Distributed query planning
11. 22:40Distributed transactions
12. 24:59Concurrency and deadlocks
13. 28:27Distributed deadlock detection
14. 32:38Q&A and conclusion

" related talks

• 08mFoundations of Distributed PostgreSQL with CitusOnder Kalaci · Azure Cosmos DB: Liftoff 2022
• 31mSharding Without the ComplexityCédric Villemain · PG Day France 2024
• 31mKEYNOTE: The Distributed PostgreSQL Problem & How Citus Solves itMarco Slot · Citus Con: An Event for Postgres 2023
• 33mCitus & Patroni: The Key to Scalable and Fault-Tolerant PostgreSQLAlexander Kukushkin · Citus Con: An Event for Postgres 2023
• 28mEfficiently distributing Postgres with Citus – How to choose the right shard key?Sai Krishna Srirampur · Citus Con: An Event for Postgres 2022
• 32m8 keys to the growth of Citus & Distributed PostgreSQLUmur Cubukcu · Citus Con: An Event for Postgres 2022
• 28mCitus on KubernetesÁlvaro Hernández · Citus Con: An Event for Postgres 2023
• 16mKeynote – Umur CubukcuUmur Cubukcu · PGConf Silicon Valley 2015