Migrating Applications Between Cassandra Clusters with No Downtime
summary
Open-source Apache v2 tooling provides a stateless CQL proxy (Go, Docker) that does synchronous dual-write to origin and target clusters and only returns success after both ACK, plus an existing data migrator (Spark/CQL export) that preserves timestamps, TTLs and can reconcile differences. It supports CQL protocol v2–4, negotiates downgrades, adds single-digit-millisecond overhead per request, has run in production for 2+ years on 20+ TB migrations, lets reads be mirrored for validation, and allows instant rollback by repointing clients.
AI-written summary · about
chapters (14)
- 0:00Zero downtime migrations intro
- 2:07Defining zero downtime
- 3:59Migration use cases
- 7:55ZDM proxy and tools
- 13:56Migration process
- 15:19Deploy ZDM proxy
- 18:53Final verification
- 20:39Phase two migration
- 22:02Async dual read test
- 23:27Switch reads to target
- 24:32Point of no return
- 25:13Future improvements
- 26:20Open source demos
- 27:23Q&A
related talks
35mCassandra Data Migration with Dual Write Proxy
24mZero Downtime Mastering Cassandra Live Migrations at Scale
24mMigrations under Production Load: How to Switch...
45mFrom SQL to Cassandra
34mLarge Scale NoSQL DB Migration Under Fire
20mMoving Apache Cassandra command execution and monitoring from JMX to CQL: A Developer's Overview
29mCassandra - an introduction
40mLatency, Throughput & Fault Tolerance: Building a Modern Database