~/talk

Delta Lake: Turn your Data Lake into a Lakehouse

Talkat DataEngBytes 2022 · 2022-09-27..09-29· [data-engineering]
links:none on file
slides:none on file

Delta Lake is presented as an open‑source protocol that adds ACID guarantees and warehouse features onto parquet files stored in a data lake, with co‑located _delta_log JSON files recording every transaction (adds/removes, stats for file skipping). Demo uses a Kaggle Stack Overflow set (~3.3 million rows, 3.7 GB) to show MERGE/upsert behavior, schema evolution and constraints, time travel by version or timestamp, Change Data Feed for CDC, and mentions OPTIMIZE/ZORDER/VACUUM and Delta Lake 2.0 experimental.

AI-written summary · about

  1. 0:00Intro
  2. 0:48What is a Lakehouse
  3. 3:08Delta Lake
  4. 7:03Demo
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.