The Enterprise Guide To Building A Data Mesh
summary
Claim: a specification-driven pipeline turns domain specs into real Kafka topics, ACLs and schema registry entries so teams publish data products that are discoverable and self-serve. Implementation uses AsyncAPI-like specs in a GitHub template, unit tests that spin up local Kafka containers, programmatic Terraform via Terraform CDK to provision clusters, and pushes schemas to schema registry and tags to a data catalog. It’s working end-to-end in proof-of-concept deployments but remains early and seeking adopters.
AI-written summary · about
chapters (5)
- 0:00Introduction and goals
- 2:04Data mesh theory
- 7:45The spec mesh approach
- 15:57Capture, provision, and serve
- 18:27Tooling and future roadmap
related talks
48mBuilding a data mesh
57mOur DataMesh Journey: data architectures for microservices
34mTransforming Data Processing with Kubernetes: Journey Towards a Self-Serve Data Mesh
40mA Data Mesh Of Streams
45mRethink Data Accessibility: Data Mesh meets Enterprise Integration
44mData Mesh
38mPlatform Building for Data Mesh - Show me how it is done!
25mFrom Guesswork to Governance: Bringing API Discipline to Data Streaming