~/talk

One dataset and three use cases with Microsoft Fabric

Talkat SQLBits 2024 · 2024-03-19..03-23· [data-engineering, data-visualization]
links:none on file
slides:none on file

Imports World Bank Open Data into Microsoft Fabric using three concrete ingestion methods: Dataflow Gen2 to Lakehouse, Data Pipelines with copy assistant and Teams alerts, and Spark Notebooks that handle API paging. Builds Lakehouse tables and a default SQL semantic model, orchestrates refreshes and shows improved refresh history and metadata. Demonstrates 26 lines of notebook code to fetch and profile many indicators, loads CSVs via pipelines into Lakehouse, and produces Power BI reports from the created datasets.

AI-written summary · about

  1. 0:00Microsoft Fabric introduction
  2. 8:17Data warehouse vs lakehouse
  3. 17:41Data ingestion pipelines
  4. 29:39Orchestrating workflows
  5. 31:26Notebooks for processing
  6. 40:23Lakehouse modeling
  7. 47:43Self-service BI
  8. 50:11Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.