Keynote - Data Mesh
summary
Centralised big‑data platforms repeatedly fail to scale and deliver value, according to NewVantage Partners and casework cited, so Data Mesh applies four concrete prescriptions: decompose analytics by business domain ownership; treat each dataset as a data product with input/output/control ports (CDC, columnar files, SQL endpoints, APIs); provide a self‑serve platform that boots data products from a declarative spec (hiding Databricks, Airflow, S3/ADLS plumbing); and enforce federated governance to codify global metadata and quality rules.
AI-written summary · about
chapters (4)
- 0:00Start
- 13:55FAILURE SYMPTOMS
- 23:05BUILD AN ECOSYSTEM Create a federated and global governance to enable interoperability
- 31:48Paradigm Shift FROM
related talks
36mIntroducing Data Mesh A Paradigm Shift In Analytical Data Management Architecture
48mData Mesh Paradigm Shift in Data Platform Architecture -
20mEmbracing Data Mesh: A Modern Strategy for Scalable Data Management
39mData Mesh: Why, What and How
47mModern Data Architecture: Breaking the Big Data Monolith
43mUntangling Data Mesh: A paradigm shift in Big Data
13mData Mesh is a Big Idea: Take Your Team From Vision To Reality
51mPanel Debate: Data Mesh – What You Need To Know