~/talk

No no storage limits, just reach for the sky, with data virtualization in SQL MI

Talkat SQLBits 2023 · 2023-03-14..03-18· [databases]
links:none on file
slides:none on file

Azure SQL Managed Instance queries data directly on Azure Blob/ADLS Gen2 (CSV, Parquet, JSON) via external tables or OPENROWSET, using managed identity auth, so cold data lives off-instance while queries join local and external sources. Practical savings: MI has a 16 TB local limit, but a demo shows scanning 4.7M remote rows reduced to ~23K with predicate pushdown, cutting query time from ~5s to near instant by using parquet and the Latin1_General_100_BIN2_UTF8 collation; partition elimination and file functions also work.

AI-written summary · about

  1. 0:00Introduction and overview
  2. 2:04What is Azure SQL MI
  3. 5:13Why data virtualization
  4. 7:21How data virtualization works
  5. 11:17Demo: Data exploration
  6. 19:10Demo: Partitioned data access
  7. 23:12Performance optimization tips
  8. 29:13File functions and partition elimination
  9. 36:35Mixing local and remote data
  10. 41:28Roadmap and future plans
  11. 47:18Q&A and closing
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.