Intro: Dragonfly

on YouTube ↗37m

" summary

An open-source P2P image and file distribution system built for production scale, Dragonfly uses a P2P supernode + DFget clients architecture, block-level transfers, dynamic compression and an in-memory file system to cut cross-region bandwidth and registry load. It runs at 1.5 billion downloads/month inside Alibaba, keeps average pull cost flat as concurrency grows (native registries spike), and shows ~3x faster deployments in adopters. Refactored in Go, it supports HTTP registries, CDN seeding, encryption and plugin-based scaling.

AI-written summary · about

" chapters (14)

1. 0:00Introduction
2. 3:32Milestones
3. 7:33Status of Dragonfly
4. 9:29Dragonfly Community
5. 13:25Supernode Architecture
6. 14:45Dispersity Theory
7. 19:25Compression
8. 21:25Storage Manager
9. 25:25Demo
10. 27:25Data comparison
11. 29:25Scalability
12. 31:25Repository
13. 33:25Supernode
14. 35:25Syncing

" related talks

• 25mDragonfly's CNCF Graduation Journey and Large-Scale AI Model Distribution in Pra...F. Lyu, W. Qi · KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China 2026
• 30mData @Scale Seattle Samir GoelSamir Goel · Data @Scale Seattle 2015
• 30m🛠️ Filecoin data onboarding with DeltaElijah Seed-Arita · HackFS 2023
• 30mPeernet - an open p2p network standard / implementationAkilan Selvacoumar · Conf42 Golang 2022
• 14mFalconFS: Distributed File System for Large-Scale Deep Learning PipelineXinwei Hu, Lu Zhang, Haibo Chen, Mingkai Dong, Jingwei Xu, Junbin Kang, Mingyu Liu, Shaohong Guo, Ziyan Qiu, Mingzhen You, Ziyi Tian, Anqi Yu, Tianhong Ding · NSDI '26
• 30m🛠️ Filecoin data onboarding with DeltaElijah Seed-Arita · HackFS 2023
• 15mThe State of FilecoinJuan Benet · TOKEN2049 Singapore 2023
• 45mA Distributed File System for Secure P2P ApplicationsBrooklyn Zelenka · Strange Loop 2022