Unifying Data for Data Applications with the Data Lakehouse
summary
Claim: a lakehouse unifies scattered data so different tools query one canonical copy without copies or costly ETL. It standardizes storage as parquet files plus a table format like Apache iceberg (speaker cites datasets spanning 100,000 parquet files), federates sources via a middle layer like Dreo so the application uses one scoped credential, and speeds queries with automatic caching/reflections and modern transport like Apache Arrow Flight to avoid heavy serialization.
AI-written summary · about
chapters (9)
- 0:00Data lakehouse introduction
- 3:32Modern data challenges
- 7:05Solving data silos
- 13:26Apache Iceberg table formats
- 16:54Unifying data with Dremio
- 19:21Semantic layers for AI
- 21:51Apache Arrow Flight
- 23:56AI integration with MCP
- 25:18Performance optimization
related talks
34mData Lakehouse: Who, Why and How
25mBuild open format data lakehouse
11mBreaking Data Silos: Enterprise Data Management
28mLakehouse Architecture with Delta Lake and Databricks
31mData Warehouses Meet Data Lakes
40mUnbundling of the Cloud Data Warehouse: Open Source Databases and Data Lakes
34mCatalogs, Iceberg, and Delta: Building the Foundation for Lakehouse Analytics
36mThe Data Lakehouse