Joel Minnick, Databricks | Databricks Data + AI Summit 2024
summary
Databricks open-sources Unity Catalog and announces a Tabular acquisition to make Iceberg and Delta Lake interoperable, claiming 7,000 Delta Lake customers and adding a metric store inside the catalog so governance covers business metrics as well as data. Platform goes fully serverless to cut TCO and idle costs. New Agent Framework and Mosaic AI target compound AI workflows that stitch vector DBs, specialized LLMs and evaluators together. Only about 15% of GenAI projects are in production now.
AI-written summary · about
chapters (13)
- 0:00Databricks innovation theme
- 1:02Open sourcing Unity Catalog
- 2:16Interoperability strategy
- 3:26Data governance and growth
- 5:12Bridging data and analytics
- 7:17Efficiency and serverless
- 9:45The role of Mosaic AI
- 11:47Compound AI systems
- 14:48Tooling and AI frameworks
- 16:52Small language model adoption
- 18:44Real-world AI use cases
- 20:34Community-led growth
- 22:37Market education and vision
related talks
03mDay 2 Opening Remarks
05mDatabricks Product Announcements
34mOverview of the Databricks Platform
52mElevate your data and AI governance with Databricks Data Intelligence Platform
20mKeynote Review
49mGenAI for Business on the Modern Data Stack
49mBuild & deploy generative AI apps in days with Databricks Lakehouse AI
14mKeynote Analysis Day 2