Data governance and distribution with Dat
summary
A three-person team (expanding to seven) builds Dat: a Node.js, peer-to-peer system using hyperdrive, discovery-swarm and Rabin fingerprinting to chunk files for streaming, versioned, content-addressable endpoints. Demo shows a browser hashing 100 MB, serving CSV rows and playing a movie before full download, avoiding Git’s >100 MB pain. Plans include server backup nodes, HTTP fallback, a desktop UI and daily scrapers for open data funded with $420,000 from the Knight Foundation.
AI-written summary · about
chapters (7)
- 0:00Introduction to Dat
- 2:00Problems with current data sharing
- 6:16Introducing Dat solution
- 11:19Live demo of Dat in browser
- 15:38How Dat handles streaming and indexing
- 17:47Future plans for Dat
- 20:38Q&A on technical details
related talks
25mIt's Time to Reinvent the Web, Without the Internet
01h 00mThe Decentralized Web
43mIntro: Dragonfly
34mPermanent webapps
14mResilience or Building on Quicksand: Decentralized Infrastructure
33mAI Your Data
27mThe Dark Forest: Private CRDTs as Global Database
27mDecentralized Storage with IPFS: How does it work under the hood?