Why the Lakehouse?

on YouTube ↗21m

" summary

Argues that a Lakehouse replaces a separate warehouse by putting Delta-format files plus a transaction log into cheap scalable storage, giving ACID + time travel and schema evolution or enforcement so curated tables can live on files. Shows an Azure stack example: Azure Data Lake Storage Gen2 + Event Hubs + Databricks or Synapse + Power BI. Notes Delta is open source, large-query performance beats warehouses, small-query latency favors relational systems, and Spark supports SQL on Spark with Python/Scala for automation.

AI-written summary · about

" chapters (11)

1. 0:00Start
2. 1:34A IS THIS A TIMESHARE?
3. 2:38PATH TO THE LAKEHOUSE
4. 3:11THE DATA WAREHOUSE
5. 4:10THE MODERN DATA WAREHOUSE
6. 6:07A LAMBDA ARCHITECTURE
7. 6:45THE DATA LAKEHOUSE
8. 8:05A DELTA FEATURES
9. 10:23AAN AZURE DATA LAKEHOUSE
10. 11:22COMMON LAKEHOUSE TECHNOLOGIES
11. 12:29A SKILLS GAP

" related talks

• 28mLakehouse Architecture with Delta Lake and DatabricksDragan Beric · DSC Europe 2022
• 44mWhat's the Best Big Data Architecture for You?Christoph Windheuser · GOTO Amsterdam 2024
• 51mHow to Build a Modern Data Lakehouse?Piotr Kalinowski · 4Developers 2022 Online
• 24mData Mesh and LakehouseMatei Zaharia · State of Data Mesh 2022
• 20mDelta Lake: Turn your Data Lake into a LakehouseVinoaj Vijeyakumaar · DataEngBytes 2022
• 18mDelta Lake – The Foundation Of Your LakehouseSARAH CARTHY · Big Data LDN 2022
• 40mData Lake House in the Cloud: The Azure SolutionsDennes Oliveira · Data Con LA 2021
• 28mScaling the Future: Lakehouse Architecture and OpenSource CollaborationVictor Botan · Voxxed Days Bucharest 2026