The Full Stack Preview: Kubernetes, ArgoCD, and Ephemeral Databases
summary
Built per-PR full environments using ArgoCD ApplicationSet PR generator, each provisioning app pods plus a single-member mongod replica (Atlas local image) restored from a nightly dump-and-restore to S3 with ArgoCD sync waves and post-deploy migrations; Redis is namespaced, S3 uses copy‑on‑write prefixes, and idle previews auto‑destroy after two weeks. Startup time falls from ~50 minutes to ~5 minutes after tuning, 95% of PRs still don’t need DB isolation, and cost lands at €240 per PR (~€7,000/month) with spot instances avoided.
AI-written summary · about
chapters (16)
- 0:00Introduction and context
- 1:09Early development environment struggles
- 5:42ArgoCD preview environment setup
- 8:50Goals for isolated preview environments
- 9:51Database isolation challenges
- 12:21Dark deployment and cost control
- 13:05Data restoration process
- 16:35Optimizing preview environment startup
- 17:37Storage and volume management
- 19:01Infrastructure adjustments for MongoDB
- 21:10Isolating Redis and RabbitMQ
- 22:57S3 copy-on-write strategy
- 24:00Shared services decisions
- 24:44Cost analysis of preview environments
- 27:14Engineering velocity and infrastructure
- 29:21Q&A session
related talks
33mA Journey To Ephemeral Test Environments With EKS and ArgoCD
27mEphemeral Environment Practices - the Good, Bad, and Ugly
32mMaximizing development experience by minimizing cost
32mPreview Environments with ArgoCD
24mBeyond Review Apps: Orchestrating Full-Stack Ephemeral Environments...
12mApplication Preview Environments in 5 Minutes
31mImplementing Preview Environments with GitOps in Kubernetes
31mHundreds of Clusters Sitting in a Tree with Argo CD