Why operationalizing data mesh is critical for operating in the cloud
summary
Capital One operationalizes data mesh by shipping a central platform that combines one way in ingestion, a usability layer for publishing and consuming, and an orchestration layer that auto-provisions S3 buckets, Snowflake warehouses and Kafka topics. Automated governance enforces sensitivity, lineage and data quality checks at publish time, driving adoption via the automation of governance. The Snowflake self‑service product claims 27% cost savings, a 43% lower cost per query, 55,000 hours saved and 450 business use cases onboarded.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 0:24Agenda
- 0:45Background Info
- 1:30Key Learnings
- 2:30Product Management Design Thinking
- 3:48Data Catalogs
- 6:01Data Mesh
- 7:13Scaling the Data Ecosystem
- 12:27Key to federating
- 12:43Data producing experience
- 17:30Automation of governance
- 18:03Data consumer experience
- 20:48Selfservice data governance
- 23:16Selfservice data infrastructure
- 26:32Closing thoughts
related talks
01h 02mShift Data Quality Left with Data Mesh Principles
47mData Mesh - a hot air balloon?
43mWhen design meets data: Using Data Mesh for a consumer and business-driven data strategy
36mIntroducing Data Mesh A Paradigm Shift In Analytical Data Management Architecture
48mData Mesh Paradigm Shift in Data Platform Architecture -
33mLeaning into the Data Mesh
31mData Mesh In Practice – How To Set Up A Data Driven Organization
28mUsing Dataops To Build And Manage Data Products On Snowflake