Vindicating ZFS with PostgreSQL: Unleashing the Power of Scalability
summary
Claim: ZFS on Linux can reach parity with XFS/EXT4 after careful tuning. Setup uses PostgreSQL 16.2 on Rocky Linux 9.3 in GCP, PGbench scale 500, separate WAL and ZIL devices. Baseline shows 1700 TPS vs 4,900 TPS on XFS, but enabling lz4 compression shrinks the data from ~7.4GB to <1GB and speeds writes, and adjusting ZFS module/ARC plus setting recordsize 16K yields throughput at or above optimized XFS. Tests are reproducible but sensitive to config.
AI-written summary · about
chapters (13)
- 0:00Introduction
- 3:42PostgreSQL on Linux problems
- 7:38Optimizing PostgreSQL and Linux
- 9:02ZFS overview and PostgreSQL
- 15:48Test setup and config
- 21:10Benchmarking with pgbench
- 23:41ZFS performance baseline
- 24:26Optimizing ZFS access and compression
- 26:35ZFS record size tuning
- 27:42Advanced ZFS caching
- 29:49Performance comparison
- 30:34ZFS best practices
- 32:02Conclusion and Q&A
related talks
25mVindicating ZFS with PostgreSQL: Unleashing the Power of Scalability
50mPostgres vs. Linux filesystems
51mPostgreSQL on ZFS
30mOpenZFS and Linux
32mOn compression of everything in Postgres
46mUnlock PostgreSQL’s True Performance with Local SSDs
56mPerformance Improvements in PostgreSQL9 2
28mRun PostgreSQL in Warp Speed Using NVMe/TCP in the Cloud