Whitefox: simple table format sharing
summary
Whitefox claims a working, open-source zero‑copy data-sharing layer that extends Delta Sharing to serve Iceberg, Delta Lake and Hudi tables by converting metadata and enforcing access without duplicating files. Implementation uses Java 17 + Quarkus, ships as a Docker image with Terraform deployment, and integrates Keycloak authentication to map shares, schemas and grant rules to object‑storage policies. The repo is public and the system is already usable for cross‑engine queries from Trino/Presto/Spark.
AI-written summary · about
chapters (9)
- 0:00Introduction to Whitefox
- 1:14Data platform trends in 2024
- 2:18Evolution of data storage technologies
- 8:49Table formats and their benefits
- 12:01Challenges in data sharing
- 16:53Limitations of existing solutions
- 19:46Introducing Whitefox solution
- 22:42How Whitefox works
- 23:44Implementation and roadmap
related talks
15mDelta sharing: An open protocol for secure data sharing
24mData Mesh and Lakehouse
36mTable Formats Change Everything (By Not Changing Anything)
05mThe Future of Lakehouse Format Interoperability
33mThe advent of the open data lake
31mOpen Standards and Lakehouse AI Development
30mDelta Lake and Delta Sharing
22mData Exploration Made Easy with Open Source