DataOps as a Service
summary
Company builds an open‑source framework called Versatile Data Kit that combines a Python SDK and a managed control service to put data jobs into production with one-line deploy. It captures end‑to‑end data lineage, ships data‑quality plugins, multi‑tenancy, built‑in monitoring and alerting (Slack hooks), and supports SQL/Python workloads. Used at VMware to stop a CEO report outage caused by a Salesforce column type change; teams report debugging costs ~40% of daily time and gain traceability and self‑service deployment. UI is not yet shipped.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:48Holiday report failure story
- 3:54Fragmented data infrastructure
- 7:49Unified data workflows
- 10:22Data as a product
- 11:49Data versus infrastructure goals
- 13:14DevOps to DataOps
- 15:01Verse Style Dedicate framework
- 16:45Data lineage and traceability
- 19:59Framework workflow changes
- 21:26Future of Verse Style Dedicate
- 22:10Q&A
related talks
26mApplying DevOps practices in Data and ML Engineering
30mDataOps: Much More Than DevOps for Data
41mData DevOps is Real!
30mDevOps For Data Teams
30mDevOps is to Infrastructure as Code, as DataOps is to...?
28mDevOps in a Data Warehouse: Inside Out
37mWhat is DataOps? Becoming a Truly Data-Driven Organization
47mDataOps for AI-Ready Platforms