Consistent Backups for Multi-Shard MongoDB
summary
Describes a reproducible method to produce cluster-wide consistent backups for multi-shard MongoDB by coordinating mongodump with continuous oplog capture so every shard is brought to the same cluster time for point-in-time recovery. Presents an agent-per-node utility that speaks the MongoDB protocol, runs mongodump on selected primaries/secondaries, records oplogs, compresses with zstd/gzip and stores archives to S3-compatible storage; supports MongoDB 3.6, 4.0 and 4.2 and has been used in production for about 1.5 years.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:21Data consistency in backups
- 4:19Sharded cluster issues
- 7:20Solving consistency problems
- 9:50Percona Backup for MongoDB
- 13:22Backup storage setup
- 15:16Open source solution
- 17:05Backup features
- 18:57Point in time recovery
- 20:46Tool development plans
- 21:53Q&A
- 23:42Q&A
related talks
40mMongoDB Backups Overview
26mCurrent state of MongoDB Backup options
39mPhysical Backups with Percona Backup for MongoDB
30mHow to Automate, Monitor and Manage your MongoDB Servers
07mPBM -The backup OpenSource tool for MongoDB
29mMulti Active-Active and disaster recovery with MongoDB database center
09mOpen Software for MongoDB Where Percona Fits
52mPBM - The Backup Open Source Tool for MongoDB