What is DataOps? Becoming a Truly Data-Driven Organization
summary
DataOps presents making data a product through culture, processes and tools, with a core emphasis on "tests first" for data and transformations to restore user trust. It advocates git-style versioning of code, models and datasets, CI/CD, containerised environments, metadata and governance to create replayable pipelines and snapshot restores; practical rules include versioning data and code, automating environments, and measuring that pipelines can be rerun end-to-end.
AI-written summary · about
chapters (9)
- 0:00DataOps introduction
- 1:29Unreliable data cycle
- 4:02DataOps origins
- 6:10DataOps culture pillars
- 9:19DataOps production process
- 17:19Seven DataOps steps
- 28:17DataOps tools
- 31:34Before vs after DataOps
- 34:02Q&A
related talks
41mDataOps as a New Weapon for Data-Driven Companies
30mDevOps to DataOps
30mDataOps: Much More Than DevOps for Data
51mFrom DevOps for data to DataOps
20mDevDataOps - Using data for exponential growth of your organization
33mAdopt Dataops Practices and Build a Datafabric
30mDevOps is to Infrastructure as Code, as DataOps is to...?
23mOpen Source DataOps and MLOps Strategies