Flaky Tests: The Method
summary
Diagnosis and debugging of flaky (intermittently failing) automated tests in Selenium-based test suites. The talk presents concrete investigation techniques and a systematic method for finding root causes of phantom test failures, illustrated with new real-life examples and demonstrations.
AI-written summary · about
chapters (8)
- 0:00Flaky tests intro
- 3:46Flaky tests problem
- 10:54Uncontrolled time in tests
- 17:19Auto-save log analysis
- 23:02Distrusting UI in tests
- 34:30Finding flaky test causes
- 43:18Mitigating flaky tests
- 57:45Q&A
related talks
42mFlaky tests are a pain
40mFinding Flakiness: The Real Reasons Your Tests Aren't Reliable
48mFlaky Tests 2.0
47mHow to Un-Flake Flaky Tests- a New Hire's Toolkit
28mTest flakiness; methods for dealing with flaky tests
45mA Good Flaky Test Is an Unrun Flaky Test
31mYour Tests Aren’t Flaky, You Are!
22mTest Confidence: Types of Flake & How to Remediate