Delta sharing: An open protocol for secure data sharing
summary
A protocol and server that lets a provider share live Delta Lake tables (Parquet with Delta transaction logs) to any client — pandas, Spark, Tableau — by granting read‑only shares and returning short-lived cloud storage URLs so recipients read only the needed objects. The server enforces permissions, produces fine‑grained audit logs, and uses file-level filtering to avoid copying whole tables; demo shows pip install and calling delta_sharing.load_as_pandas to get a dataframe, proving the flow works end-to-end.
AI-written summary · about
chapters (6)
- 0:00Introduction and speaker intro
- 1:48What is Delta Sharing
- 3:54Delta Sharing pillars and vision
- 7:47How Delta Sharing works
- 12:01Demo setup and provider side
- 13:54Demo recipient side and data access
related talks
30mDelta Lake and Delta Sharing
06mData Sharing and Cross-Organization Collaboration
38mGetting Started with Delta Lake
39mDelta Lake: Diving into Data Lakes Without the Downsides
20mDelta Lake: Turn your Data Lake into a Lakehouse
31mDelta Lake: Open Source Reliability and Quality for Data Lakes
46mOpen Table Formats in the Wild: From Parquet to Delta Lake and Back
58mBuild reliable data lakes with Delta Lake & Databricks