Federating Queries Using postgres_fdw

on YouTube ↗54m

" summary

Sets up postgres_fdw on PostgreSQL 9.3, creates foreign servers, user mappings and foreign tables, then federates with union all views over eight nodes in a round‑robin demo (counts across eight nodes finish in ~3 seconds on a laptop). Builds work but exposes limits: foreign tables have no constraint exclusion, executor issues sequential remote scans, joins and averages pull raw rows back, and network/trip overhead is real. Recommends careful node/table placement, tuning, and staging before committing.

AI-written summary · about

" chapters (19)

1. 0:00Introduction
2. 2:44Limitations
3. 7:12Creating a federated view
4. 8:47General federated strategies
5. 13:00Demo
6. 15:00Network overhead
7. 17:30Dumb queries
8. 19:15Grouping
9. 20:12Bubble joins
10. 22:00Keys
11. 24:45Check constraints
12. 30:13Large working set
13. 32:19Nodelevel partitioning
14. 35:19Distributed processing
15. 37:04Distributed replication
16. 38:28Advice
17. 41:22Questions
18. 46:34Use Cases
19. 49:46Is it Worth It

" related talks

• 52mSharding PostgreSQL using Foreign Data WrappersKrishna Sarabu · PGConf NYC 2022
• 34mJoining Heterogeneous Databases is a reality, not a MythIbrar Ahmed · Percona Tech Days 2020
• 46mWriting a Foreign Data WrapperChristophe Pettus · PGCon 2023
• 50mBeyond Foreign Data Wrappers: building a data warehouse from heterogeneous external data sourcesChad Slaughter · PostgresOpen Silicon Valley 2017
• 39mPostgreSQL: Joining Heterogeneous Databases is a reality, not a MythIbrar Ahmed · Nerdearla 2020
• 34mPostgreSQL sharding, state of the artJulien Tachoires · PGConf NYC 2021
• 27mMigrating from MSSQL to PostgreSQLRobert Bernier · Percona Tech Days 2020
• 25mRuby and PostgreSQL, a love storyFranck Verrot · RubyKaigi 2015