Migrating a database over 10TB from DB2 to PostgreSQL with zero downtime

on YouTube ↗42m

" summary

Migrating a >10TB database from IBM DB2 to PostgreSQL while keeping the database online by tracking changes with triggers, transforming data (including moving BLOBs into Ceph), and respecting table dependencies discovered by a modified SchemaSpy. The migration uses Spring Batch for the bulk move, partitions the workload either by equal id-range segments or by ranges with equal row counts, and aims to complete within acceptable time with minimal downtime.

AI-written summary · about

" chapters (8)

1. 0:00Introduction
2. 3:14Table dependency analysis
3. 6:58Migration tools
4. 16:03Data migration schema
5. 20:24Change tracking
6. 27:38Data partitioning
7. 32:23Summary
8. 38:10Q&A

" related talks

• 26mMastering Large-Scale PostgreSQL MigrationJulien Acroute · PG Day France 2024
• 59mLarge Scale MySQL Migration to PostgreSQLDimitri Fontaine · Postgres Open 2012
• 29mTales from the Field - Oracle to PostgreSQL migrationsAdithya Kumaranchath · POSETTE: An Event for Postgres 2024
• 48mMigrating to PostgreSQL: Strategies, Sovereignty, and SuccessRaphael Salguero · PostgreSQL Conference Europe 2025
• 31mModernizing a megascale databaseToua Her, Vishal Prabhu, Sudarsanan Ranganathan · AWS re:Invent 2022
• 25mMigrating VLDBs from Oracle to Azure Database for PostgreSQLAdithya Kumaranchath · POSETTE: An Event for Postgres 2026
• 51mOracle to PostgreSQL Migration with Near Zero DowntimeSumit Aneja, Vinay Kamble · Percona Live 2022
• 34mPartitioning and Data Migrations Using PostgreSQL as an ExampleDenis Ivanov · HighLoad++ 2014