~/talk

πŸ› οΈ Filecoin data onboarding with Delta

Talkat HackFS 2023 Β· 2023-06-02..06-21Β· [data-engineering, databases]
slides:none on file

Delta is a daemon + REST API that automates Filecoin dealmaking: Delta does CAR and piece-commit generation, supports online/offline transfers over HTTP or libp2p, and offers hosted or open-source (github.com/application-research/delta) deployments. COMP times drop from ~3–5 minutes to ~2 seconds on dedicated hardware. Small files get packed and batched by Edgeur for immediate libp2p pins; massive uploads use Delta DM to manage terabyte datasets, replicate to multiple SPs, track deals, and drive an accessible UI.

AI-written summary Β· about

  1. 0:00Start
  2. 1:08Getting data onto Filecoin (Part 4)
  3. 5:06Filecoin Data Tools
  4. 11:11Optimization 1: CommP Generation
  5. 24:06Delta Dataset Manager
  6. 24:57Dataset upload process
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark β€” the status bar button does the same
?
this help
esc
close this, then clear every filter β€” or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.