Continuous Improvement

on YouTube ↗35m

" summary

Built Etsy's CI that supports continuous delivery with 96 deployments in one day and uses feature flags so code lands dark then flips on; production monitoring aggregates about quarter million metrics so teams surface problems via dashboards and catch a major outage in 20 minutes and subtle micro‑outages within hours. QA shifts from end‑of‑line checking to exploratory testing, close to the code, pairing with ops and devs; organizational change needs engineering‑level oversight to make automated checks, monitoring and production testing effective.

AI-written summary · about

" chapters (12)

1. 0:00Intro
2. 0:43The Canonical Agile Release Cycle
3. 1:43The Continuous Delivery Environment
4. 2:53How Continous Delivery Differs from "Canonical" Agile Process
5. 5:26Observed Behavior Of Complex Systems
6. 10:39Falsehoods About Quality Assurance
7. 17:23Leveson's 3 Practices For Limiting Risk
8. 19:00Characteristics of Resilient Software
9. 22:06Exploratory Testing
10. 26:26Anomaly detection is hard.
11. 27:42Keep the feedback loop short.
12. 30:35Questions?

" related talks

• 38mBuilding a high quality productFinn Lorbeer · DevOne Detroit 2018
• 33mSoftware development practices for companies that want to make an impactYuval Pemper · Nerdearla 2020
• 24mEtsyChad Dickerson · RailsConf 2011
• 25mDevOps Handbook Experiments in Accelerating DeliveryJim Grafmeyer, Cindy Payne · DevOps Enterprise Summit San Francisco 2017
• 12mConvergent Quality EngineeringJyotheeswara Reddy Gottam · Conf42 Machine Learning 2025
• 30mRelease Early and Release Often: Reducing deployment frictionAndy Delcambre · RubyConf 2011
• 34mContinuous Integration: A Bittersweet Love StorySuzie Prince · DevOpsDays Seattle 2017
• 55mContinuous Deployment Workflows for Modern JavaScriptNick Van Weerdenburg · Spotlight: Advanced JS 2013