Columnar Store for PostgreSQL
summary
c-store fdw is an open-source columnar foreign-data-wrapper for PostgreSQL that writes column stripes using the ORC format, installs as an extension, and currently loads data only via COPY. Measured on 10 GB TPC-H, typical query times improve ~25–50% and IO for some queries falls from ~9 GB down to 0.8–1.8 GB; compression yields about a 25% compression ratio and lets more data fit in memory. Roadmap includes inserts/updates, vectorized execution, and alternate codecs.
AI-written summary · about
chapters (20)
- 0:00Intro
- 3:39How does it work
- 5:00Columnar Store
- 5:25Motivation
- 7:05Demo
- 7:43Building the extension
- 11:22Creating a foreign table
- 12:40Running the copy command
- 14:18Performance tests
- 17:52State of the Store
- 19:52Orca File Layout
- 21:04Orca File Architecture
- 22:54Compression
- 23:59Compression Graph
- 25:50IO Bypass
- 27:58Benchmark Results
- 28:56Benchmark Results SSD
- 33:30Situs Architecture
- 35:19Store
- 38:08Summary
related talks
34mIn core compression-How to shrink your database
26mColumnar Storage: Redefining Data Management for the Modern Era
36mA journey toward the columnar data store - lessons from past discussions and new proposals
42mColumnar Storage: Redefining Data Management for the Modern Era
21mAnalytics in Postgres –A decade in the making
01h 00mColumnar DBMS: The Magic of Data Compression and Super-Fast Queries
PolarStore: High-Performance Data Compression for Large-Scale Cloud-Native Databases
27mBuilding a PostgreSQL data warehouse