Techniques to Eradicate Flaky Tests
summary
Argues that flaky UI/API tests are best fixed by fewer top-layer UI tests, intelligent service virtualization using spec Matic to stub external services at runtime, and visual assertions via APPL tools. Shows a demo where tests set dynamic stub expectations on a spec Matic server, the stub returns six users, the UI edit flow runs and passes, and APPL tools renders results across eight browser/device configs. Claims this removes external flakiness and scales UX checks.
AI-written summary · about
chapters (19)
- 0:00Intro
- 3:30Product Architecture
- 5:30Challenges
- 7:15Limitations
- 10:00Flaky Test
- 12:00Solutions
- 16:00Example
- 22:30Scenarios
- 26:30Screen Sharing
- 30:00Visual assertions
- 32:30The nature of testing
- 33:30Living products
- 35:30Visual AI
- 37:30Automation
- 38:30Hotspot Test
- 39:30Visual Validation
- 40:30Summary
- 41:30Virtualize dependencies
- 42:30Outro
