Puzzlefs - the Next-Generation Container Filesystem
Talkat Open Source Summit Europe 2023 · on Thursday, 2023-09-21· at 12:50· Room 0A (Floor 0), Abandoibarra Etorb., 4, 48011 Bilbao, Bizkaia, Spain·
summary
Puzzlefs implements content-defined chunking using FastCDC to deduplicate layers, stores metadata with Cap’n Proto, and provides a FUSE userspace filesystem (read-only Rust kernel driver underway). It supports optional fs-verity integrity, a canonical traversal for reproducible builds, and shared code paths between user and kernel space. A test with 10 Ubuntu Jammy images yields a unified compressed repository of 53 MB (about 93% space saved versus separate tar layers). Tools: Rust, FUSE, Cap’n Proto, FastCDC.
AI-written summary · about
chapters (13)
- 0:00Introduction to Puzzle FS
- 1:08Context and OCI basics
- 2:57OCI format and drawbacks
- 5:02Problems with tar archives
- 8:48Puzzle FS design goals
- 14:30Reproducibility and mounting
- 16:33Integrity and Rust implementation
- 19:09Shared kernel and user space
- 21:30Project status and demo
- 24:19Data format and metadata
- 28:53Comparative results
- 33:22Kernel driver and challenges
- 37:23Integration and conclusion
related talks
20mAdvanced CSI-FUSE Filesystem for AI/ML Data Management in Kubernetes
26mPains and Gains: Lessons From Orchestrating Volumes for Remote Storage in Cloud Native AI Scenarios
22mCSI Driver X FUSE Drivers: a Kubernetes Object Storage Solution for AI/ML Data Portability
29mImage Snapshotters for Efficient Container Execution in Particle Physics
32mStatus and Future of the Ceph File System
26mEnabling Seamless AI Workloads: Achieving Zero-Downtime Upgrades for FUSE in Kubernetes
31mFunction to Container - Building a FaaS Experience
34mFast Image Pulls Using IPFS And Opportunistic Caching