Revisiting Network Coding for Warm Blob Storage
summary
NCBlob is a C++ Linux prototype that encodes small blobs with non-systematic MSR codes and large blobs with systematic MSR, adds a locality manager, and uses split-merge and merge-split encoding to group hot blobs for fewer decodes. A sub-block rotation scheme extends repairs beyond two failures. Alibaba Cloud experiments show up to 45.0% reduction in single-block repair time, up to 38.4% full-node repair time reduction, and as low as 2.1% read throughput loss compared with prior systematic MSR deployments.
AI-written summary · about
related talks
17mParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage
11mExploiting Combined Locality for Wide-Stripe Erasure Coding in Distributed Storage
51mConvertible codes: Adaptive coding for large-scale data storage
18mDRBoost: Boosting Degraded Read Performance in MSR-Coded Storage Clusters
12mCodedBulk: Inter-Datacenter Bulk Transfers using Network Coding
59mPractical Error Control Coding For Data Storage
01h 14mErasure Coding at Scale
34mToward Efficient Genomic Compression Using Channel Codes For Joint Alignment And Reconstruction