pg_shardman: Sharding in PostgreSQL
summary
An experimental approach to sharding PostgreSQL using the foreign data wrapper (FDW) mechanism, the pg_pathman extension for partitioning, and PostgreSQL 10's built-in logical replication. The implementation is the pg_shardman extension (github.com/postgrespro/pg_shardman) that integrates these technologies to manage sharded deployments.
AI-written summary · about
chapters (11)
- 0:00Introduction to sharding
- 5:26What is pg_shardman
- 6:27Scalability and partitioning
- 11:07Data distribution principles
- 12:11High availability and replication
- 16:22Cluster management via shardlord
- 17:49Distributed transactions
- 24:14Transaction replication and isolation
- 27:13Time synchronization issues
- 33:18Testing and performance
- 35:50Demo and Q&A
related talks
52mSharding PostgreSQL using Foreign Data Wrappers
51mUsing Postgres FDW with a sharded PostgreSQL Database
34mPostgreSQL sharding, state of the art
45mThe Future of Postgres Sharding
45mThe Future of Postgres Sharding
53mBreakout Session
42mBeginner's Guide to Partitioning vs Sharding in Postgres
33mFive Sharding Data Models and Which is Right