~/talk

Data Contracts: Consensus as Code

on YouTube 32m
Talkat PyCon AU 2023 · 2023-08-18..08-22· [databases, developer-experience]

speaker

name:Ryan Collingwood
links:none on file

resources

video:https://youtu.be/L9mEGb31snk
slides:none on file

summary

Argues that data contracts as code turn fuzzy agreements into enforceable expectations by generating models, tests and infrastructure from a single source of truth. Implements a pipeline that reads spreadsheets with pandas, validates and types with pydantic, refactors with rope and runs tests with pytest and black, producing SQL data-quality checks derived from contracts. After about a month and a half the team auto-generates tests and finds mismatches earlier, proving the approach scales; tooling list: pandas pydantic rope pytest black.

AI-written summary · about

chapters (10)

  1. 0:00Introduction
  2. 3:34Data contracts defined
  3. 7:24Schema vs semantics
  4. 10:32Practical applications
  5. 13:03Data contracts in a real-world ERP system
  6. 16:12Implement as code
  7. 20:03Implementation principles
  8. 23:14Spreadsheets vs code
  9. 27:05Tooling and codegen
  10. 29:15Key takeaways and closing remarks

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.