Fabric Direct Lake Deep Dive

on YouTube ↗50m

" summary

Direct Lake mode lets Power BI query OneLake Delta/Parquet files by paging needed columns into memory on demand, converting on the fly to the VertiC in‑memory format so queries run almost as fast as import without refresh jobs. Uploads into a Lakehouse remove the import refresh step and Microsoft reports shaving about two hours off end‑to‑end pipelines. It requires Fabric/OneLake, a single Lakehouse source, disallows calculated columns/tables, can fallback to DirectQuery when memory or views/row‑security force it, and is managed via the web editor, Tabular Editor 3, DMVs, profiler and Delta analyzer notebooks.

AI-written summary · about

" chapters (16)

1. 0:00Fabric Direct Lake intro
2. 6:12Traditional BI limits
3. 10:24Direct Lake demo
4. 13:17Direct Lake benefits
5. 17:17Faster user data
6. 20:06Simpler architecture
7. 21:29Unified data access
8. 24:22Shortcuts for tables
9. 27:55Direct Lake limits
10. 30:21Fallback behavior
11. 35:47Detecting fallback
12. 40:09Delta metadata
13. 42:18Controlling behavior
14. 44:12Compression internals
15. 46:22Refreshing models
16. 48:06Q&A

" related talks

• 47mData analytics for the era of AIPatrick Baumgartner, Amir Netz, Swetha Mannepalli, Miwa Monji, Arun Ulagaratchagan, Justyna Lucznik, Ron Chang, Thasmika Gokal, Nimrod Shalit, Nandini Srinivasan · Microsoft Build 2023
• 32mEliminate data silos with OneLake the OneDrive for DataJoshua Caplan, Adi Regev · Microsoft Build 2023
• 44mUnify your data with OneLake and Microsoft FabricAbhishek Narain, Joshua Caplan, Harmeet Gill, Salil Kanade, Swetha Mannepalli, Aaron Merrill, Miwa Monji, Trevor Olson, Joanna Podgoetsky, Mark Pryce-Maher, Charles Webb · Microsoft Build 2024
• 30mDataEngBytes 2023 - BRI-T1-04 - Mimoune DjouallahMimoune Djouallah · DataEngBytes Brisbane 2023
• 46mMicrosoft Fabric Synapse data warehouse Q&AOlivia Shea, Joanna Podgoetsky, Priya Sathy, Shawndell Elfring, Bogdan Crivat, Steve Howard, Faisal Mohamood · Microsoft Build 2023
• 19mAccelerate your data potential with FabricSwetha Mannepalli · Microsoft Build 2023
• 50mFabric: What's new and what's nextAmir Netz, Arun Ulagaratchagan, Flavien Daussy, Adam Penhaul · Microsoft Build 2024
• 45mBuilding a Lakehouse on the Microsoft Intelligent Data PlatformSimon Whiteley, Craig Porteous · SQLBits 2023