Generative Integration Tests

on YouTube ↗44m

" summary

Uses Clojure/test.check, clj-webdriver (Selenium), JDBC and clj-http against a large Pivotal Tracker JS/Rails app. Generates non-empty vector of action hashmaps representing atomic UI intents, runs a dialable N cases, and applies shrinking to minimal failing case to collapse long repros into two steps. Adds execution strategies for single-browser sequences and two browsers parallel strategy to probe concurrency. Finds API-caused client crashes, a four‑year‑old SQL bug, and a rare concurrency bug reproducible ~30%, with most fixes taking hours to days.

AI-written summary · about

" chapters (5)

1. 0:00Start
2. 6:04The Downsides of Generative Testing
3. 10:06Hitting Known Trouble Spots
4. 22:57Unexpected Techniques
5. 25:00High Level Basics Multimethods are your friends

" related talks

• 32mGenerative Testing: Properties, State and BeyondJan Stępień · EuroClojure 2015
• 25mPowerful Testing with test.checkReid Draper · Clojure/West 2014
• 51mAutomating to augment testingAlan Richardson · Breakpoint 2020
• 29mState of Web Integration TestingMatti Schneider · Wildcard Conference 2013
• 37mFront-end Testing for SkepticsLuke Francl · RailsConf 2013
• 01h 14mContinuous TestingTitus Fortner · Selenium Conference India 2018
• 55mNext-Gen Testing Tools for JavaDaniel Hinojosa · Great International Developer Summit 2024
• 42mReliable and Maintainable Webdriver TestsBenji Weber · Devoxx Belgium 2017