JSConf 2015 Dave Cadwallader
summary
Builds a practical end-to-end system that stops false positives without fixing every root cause: Magellan wraps Night Watch tests, injects jQuery to work around flaky click drivers, retries failed assertions a few hundred milliseconds later and runs tests massively in parallel via Sauce Labs. Retries raise pass rates ~50% and jQuery clicks another ~25%, compressing a 90–100 minute matrix to ~15–20 minutes and achieving days or weeks without unexplained failures so the suite actually catches real regressions.
AI-written summary · about
chapters (14)
- 0:00Introduction
- 1:58Test pyramid and end-to-end challenges
- 5:55Selenium and testing complexity
- 7:21Test flake and frustrations
- 9:47Walmart Labs end-to-end quest
- 12:38Soup can metaphor for reliability
- 15:43Making flaky tests reliable
- 18:31Armored convoy testing approach
- 20:37From kludge to open source tool
- 22:25Flake, data, and parallelism
- 24:33Speed and failure isolation
- 26:41Introducing Magellan
- 28:27Shoveling as a service
- 29:28Closing
