Test-Driven Data Analysis

on YouTube ↗01h 11m

" summary

Claims a reproducible workflow: capture inputs and outputs, run reference tests that can auto‑regenerate expected results, and infer constraints on Pandas dataframes to catch drift. Demonstrations use the tdda library (pip / Github) with unittest/pytest, CSV/feather support, and a regexp generator; running constraints on elements_92 vs elements_118 shows concrete failures (max/min, nulls, duplicates). Includes commands to discover and verify constraints and to diff or rewrite references.

AI-written summary · about

" chapters (13)

1. 0:00Test-driven data analysis intro
2. 1:05What is TDD
3. 3:57Errors in data analysis
4. 15:52Why TDD matters
5. 16:14Reference tests for analytics
6. 20:12Implementing reference tests
7. 28:18Testing unstructured outputs
8. 37:43Testing structured outputs
9. 42:40Constraint discovery intro
10. 48:42Generating constraints
11. 57:19Introducing Rexy
12. 1:04:05What is Rexy
13. 1:09:24Q&A

" related talks

• 01h 31mTest-Driven Data AnalysisNick Radcliffe · PyData London 2026
• 01h 32mTest-Driven Data Analysis in PythonNick Radcliffe · PyData London 2024
• 39mDevelopments in Test-Driven Data AnalysisNick Radcliffe · PyData Berlin 2017
• 29mTDD shouldn't be TDDiousChris Sidebottom · PyData Warsaw 2019
• 01h 30mAdvanced Software Testing for Data ScientistsRaoul-Gabriel Urma · PyData New York City 2019
• 01h 29mAdv. Software Testing for Data ScientistsRaoul-Gabriel Urma, Kevin Lemagnen · PyData London 2019
• 39mUnit Testing for Data ScientistsHanna Torrence · PyData NYC 2018
• 28mHow to not pull your hair out while providing data to the businessLars Hanegraaf · PyData Eindhoven 2022