Testing Web Services with QuickCheck

on YouTube ↗45m

" summary

Property-based testing uses QuickCheck to auto-generate millions of requests from JSON schema generators and also emit a validator, then exercise real endpoints (tries Phoenix locally and targets the XC currency converter). Results include a Unicode reverse failure exposed by shrinking, a forbidden Swedish krona returned despite schema enums, a zero-vs-exclusiveMinimum bug in conversions, and timestamp race failures; at scale QuickCheck tooling finds subtle protocol bugs (20k lines of QuickCheck testing about 1M lines of C revealed several real defects).

AI-written summary · about

" chapters (17)

1. 0:00Intro
2. 0:17Erlang background
3. 2:13Why is testing hard?
4. 5:22Specify properties
5. 11:58Running QuickCheck
6. 12:52Property Based Testing
7. 21:31JSON schema generators
8. 23:24Test a currency web servicel
9. 24:35Test a currency web service!
10. 26:00Type correctness
11. 27:25Found the type error!
12. 28:33Type specification tested
13. 33:47Run the same check again
14. 35:48Web service testing
15. 36:34Currency at a given time
16. 38:37Combine JSON and QuickCheck Q
17. 40:07Conclusion

" related talks

• 53mProperty Based Testing, By ExampleMarc Evers, Rob Westgeest, Willem vd Ende · J-Fall 2015
• 41mQuickCheck Mini for ElixirThomas Arts · Berlin Erlang Factory Lite 2015
• 30mProperty-based Testing for Godly TestsGabe Scholz · ReactiveConf 2017
• 51mProperty Testing: Write Fewer Tests, Find More BugsJulien Debon · DevFest Lille 2019
• 39mPROWESS: Property-Based Testing for Web ServicesJohn Derrick · Erlang User Conference 2015
• 18mProperty-based testing beginning with SwiftCheckYusuke Hosonuma · try! Swift Tokyo 2019
• 51mProperty-Based TestingLucy Mair · NDC London 2023
• 36mProperty Based Testing: From Theory to PracticeNicolas Dubien · Best of Web 2019