Hunting Bugs While Sleeping

on YouTube ↗25m

" summary

Explains property‑based testing with the Hypothesis library, replacing fixed examples by asserting algebraic properties (commutativity, double‑reverse) and generating randomized inputs; demo uses Hypothesis statistics showing 200 examples in a run (default 100) and shows how counterexamples surface failing input combinations. Shows a separate scheduled bug‑hunting CI pipeline in Azure DevOps and GitLab (daily or hourly) that runs many samples, lets you increase to 1000+ samples for CI, and reports failing cases so tests catch bugs while the team sleeps.

AI-written summary · about

" chapters (13)

1. 0:00Introduction and background
2. 1:05What is property based testing
3. 3:18Testing without expected output
4. 5:30Exhaustive vs randomized inputs
5. 7:20Why use a library like Hypothesis
6. 8:24Advanced input criteria in testing
7. 10:11When to use property based testing
8. 11:18Automating bug hunting with CI
9. 13:04Demo setup and integration
10. 16:03Monitoring CI results
11. 17:30Scheduling bug hunting CI
12. 20:34Summary and resources
13. 21:41Q&A session

" related talks

• 27mTesting Beyond Examples: Property Based Testing with HypothesisSam Bishop · PyCon AU 2026
• 50mProperty based testing with HypothesisDavid R. MacIver · NDC TechTown 2017
• 32mMore testing with fewer testsClinton Roy · PyCon AU 2016
• 01h 07mSufficiently Advanced TestingZac Hatfield-Dodds · PyCon AU 2019
• 41mProperty Based Testing in Python with HypothesisAnthony Khong · PyCon APAC 2019
• 41mProperty Based Testing with Hypothesis: Stronger Tests, Less WorkShai Geva · PyCon Israel 2022
• 01h 31mIntroduction to Property-Based TestingZac Hatfield-Dodds, Ryan Soklaski · PyCon US 2023
• 17mStop Writing Tests!Zac Harfield-Dodds · Conf42 Python 2021