Disaster Non-Recovery
summary
Describes a real-world disaster-recovery exercise involving data-center shutdowns and a concrete failure where Patroni-managed PostgreSQL clusters recovered with masters on old timelines. Explains the operational practices and lessons learned from those drills to avoid timeline/replication split issues during DC failover and recovery.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 6:50How drills go
- 12:22What happened
- 17:50Failure causes
- 24:13Config mistakes
- 26:43Avoiding future issues
- 30:16Q&A
related talks
22mFailing Over without Falling Over
26mA Tale of Two Outages
14mThe Multi‑Workload Challenge: Predictable Failover
16mEngineering Failure-Resilient Systems
11mZero Data Loss at Scale
42mPostgreSQL Replication Conflicts: Avoiding Pitfalls
34mDatacenter Fires and Other 'Minor' Disasters
06mOoops... I Deleted the Whole Production Table. What Did I Learn From It?
