DevOps is to Infrastructure as Code, as DataOps is to...?
summary
Claim: Data Transformation as IaC makes DataOps scalable by treating transformations as repeatable, deployable code. Demonstrates a platform (Xcalar) that runs SQL and Python against unified relational tables, integrates lakes/warehouse/streams (Kafka, Snowflake), and handles multi-petabyte jobs — author cites 2 PB scale and billions of parallel ops. Promises 5x developer productivity and zero-change production deploy, includes IDE, masking/governance libraries, and commercial deployments (large investment bank) that reportedly work in production.
AI-written summary · about
chapters (14)
- 0:00The Digital Transformation Journey
- 1:41Symmetry Between Software and Data
- 2:20Accelerating Software Delivery
- 4:08Enablers of the Software Journey
- 5:44The Race to Create Value From Data
- 7:15Accelerating Insight Delivery
- 8:51Enablers of the Data Journey
- 10:13The State of the Data Journey
- 11:20Building the Modern Digital Enterprise
- 12:43Powerful Insights Rely on Data Transformat
- 14:04Large Scale Data Transformation Is Challeng
- 15:59Relational Compute: A Simpler Approach
- 17:24Data Transformations With Xcalar
- 18:06Xcalar: Go From Development to Productia Minutes
related talks
30mDevOps to DataOps
51mFrom DevOps for data to DataOps
37mWhat is DataOps? Becoming a Truly Data-Driven Organization
28mDevOps in a Data Warehouse: Inside Out
30mDevOps For Data Teams
30mDataOps: Much More Than DevOps for Data
20mDevDataOps - Using data for exponential growth of your organization
47mDataOps for AI-Ready Platforms