~/talk

Zero to Lakehouse in Microsoft Fabric

Talkat SQLBits 2024 · 2024-03-19..03-23· [data-engineering, cloud-infrastructure]
links:none on file
slides:none on file

Claims that a complete Data Lakehouse is buildable inside Microsoft Fabric as a SaaS platform without touching Azure resources, using one Lake as the storage layer and Delta under the hood for ACID transactions and time travel. Shows Data Factory pipelines, Synapse Data Engineering notebooks (Spark) and Power BI; ingests the NYC taxi dataset, runs bronze→silver→gold transforms in notebooks and queries a SQL endpoint in ~178 ms, with end-to-end transforms taking 12 seconds. Notes feature gaps: networking, security and source control are still preview or partial.

AI-written summary · about

  1. 0:00Lakehouse in Fabric intro
  2. 1:54Lakehouse architecture
  3. 4:02Microsoft Fabric platform
  4. 9:21Bringing Lakehouse to Fabric
  5. 16:38Medallion architecture
  6. 25:46Creating Lakehouse artifacts
  7. 31:29Data transformation Bronze Silver Gold
  8. 43:50Key takeaways and readiness
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.