OpenEC: Toward Unified and Configurable Erasure Coding Management...
summary
OpenEC is a middleware that decouples erasure coding control from storage workflows using an EC-deck DAG to express encoding, repair and placement, and it supports sub-packetization W plus automated transformations like pipelining and bind optimizations. Prototype adds ~7,000 lines for the framework while requiring <450 lines to integrate with each storage system, uses Intel ISA-L and Redis, runs on a 16-node cluster and EC2, preserves decoding speed but shows 29–38% encoding overhead versus ISA-L alone, and boosts hierarchical repair throughput by up to 82%.
AI-written summary · about
chapters (7)
- 0:00Erasure coding challenges
- 5:47Introducing OpenSea
- 6:23Architecture and design
- 14:37Workflow execution
- 16:18Performance evaluation
- 20:28Conclusion and future work
- 21:09Q&A session
related talks
42mErasure Codes in a nutshell
01h 14mErasure Coding at Scale
22mELECT: Enabling Erasure Coding Tiering for LSM-tree-based Storage
17mParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage
31mMulti-version Coding and Shared Memory Emulation
27mA Student's View of Locally Repairable Codes
33mThe Challenge of Storing Small Objects on a Large Scale
01h 04mEuphoric Codecs & Dazzling Rainbows