P2P Docker Image Distribution in Hybrid Cloud Environment with Kraken
summary
Kraken is a P2P docker registry that breaks images into content‑addressable blobs, runs an agent on every host plus origin and tracker services, and builds a sparse random regular graph of peer connections to distribute blobs. Benchmarks show a 3 GB image to 2,600 hosts finishes with 3 GB on 2,600 hosts: p50 10s p99 18s, max 32s. It targets hybrid data centers, uses pluggable backends (S3/HDFS/registry), is self‑healing and reduces origin load.
AI-written summary · about
chapters (31)
- 0:00Intro
- 0:29Agenda
- 1:02Docker Image
- 2:10Docker Pool
- 2:34Optimize Docker Images
- 4:11Problems with Docker Pools
- 6:00Design Considerations
- 7:38Layer Structure
- 8:53Central Over Overseer
- 9:53Random Graph
- 11:17Cody Gibb
- 11:35Vocabulary
- 12:05Kraken Architecture
- 13:15Key Features
- 14:42Peer Discovery
- 15:33Peer Discovery Visualization
- 16:03Darker Tags
- 17:00Zones
- 17:17Security
- 18:29Production
- 19:10Optimizations
- 20:42Graph Density Problems
- 21:57Takeaways
- 23:22Future plan
- 24:09Github
- 24:37Cuz
- 25:28BitTorrent
- 27:14Docker Pulls
- 27:40How Uber started using Docker
- 29:02Questions
- 29:28First Question
related talks
34mThree Approaches to Speed up Image Distribution in Cloud Native Era
30mFaster Container Image Distribution on a Variety of Tools with Lazy Pulling
34mFast Image Pulls Using IPFS And Opportunistic Caching
49mContainers All the Way Down!
57mMoby Dock in the Wind Tunnel
27mDecentralized Storage with IPFS: How does it work under the hood?
40mNode-Level Optimization in Large Cluster Powered by Containerd Plugin
05mlibp2p and the cloud