Beyond the hype: What test automation really costs
summary
Focuses on UI and API automation (not AI agents or unit tests) and claims automation only speeds delivery when paired with clarity, alignment, and the right level of investment. Names three concrete anti‑patterns: automation bloat, too many escaped bugs, and a bridle framework (flaky tests). Recommends actionable fixes: delete low‑value tests toward a minimum viable test suite, quarantine flaky tests with an SLA, align coverage with product risk, and measure ROI in time, culture, and incidents.
AI-written summary · about
chapters (7)
- 0:00Test automation costs
- 1:56Defining quality
- 4:03Top automation anti-patterns
- 6:07Automation bloat impact
- 8:38Brittle frameworks and flaky tests
- 10:48Escaped bugs and coverage
- 12:34Solving anti-patterns
related talks
51mRedefining test automation
40mThe Test Automation Firehose
47mWhat Successful Test Automation is... and Why it's NOT Testing!
21mThe Essential Pillars of Automation Testing for Success
42mOpening Keynote: Blunders in Test Automation
21mLowering End to End Testing Barriers
38mDo We Really Need A Test Automation Engineer?
16mIsn’t Test Automation a Silver Bullet?