~/talk

Power BI and Big Tables

Talkat SQLBits 2024 · 2024-03-19..03-23· [data-engineering]
links:none on file
slides:none on file

Explains when to use import vs DirectQuery and how to combine them with DAX Studio, the XMLA endpoint and Tabular Editor to manage partitions and scripts. Shows DirectQuery taking ~1,000 ms vs import under 200 ms on a 60,000‑row demo, notes VertiPaq segment sizes (1M in Desktop, 8M in large models), ~10:1 compression, and Power BI limits (Pro ~1–10 GB, Premium up to 400 GB). Demonstrates incremental refresh, composite/dual mode, hybrid partitions and aggregation tables; warns about query injection when mixing imported rows with DirectQuery.

AI-written summary · about

  1. 0:00Introduction
  2. 1:33Big data challenges in Power BI
  3. 4:00DirectQuery with big tables
  4. 15:11Storing results for faster reports
  5. 21:35Import mode for performance
  6. 24:05Tables too large for Power BI
  7. 28:45Incremental refresh for large datasets
  8. 33:24Demo: Incremental refresh setup
  9. 40:26Composite models with storage modes
  10. 44:41Dual mode for hybrid access
  11. 47:13Hybrid mode: real-time and historical
  12. 50:24Summary and Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.