ELECT: Enabling Erasure Coding Tiering for LSM-tree-based Storage

on YouTube ↗22m

" summary

ELECT implements hybrid redundancy on top of Cassandra, encoding LSM last-level SSTables offline into erasure-coded coding groups while keeping hot keys replicated; experiments with YCSB on Alibaba Cloud plus object storage show 56.1% hot-tier storage savings and 39.1% overall savings, degraded-read recovery takes ~50% longer (network-bound) but cloud latency can cut worst-case reads from ~5x to ~1.2x, and the tunable alpha parameter yields actual savings between 9.2% and 86% while preserving normal-mode throughput.

AI-written summary · about

" chapters (11)

1. 0:00ELECT and storage tiering
2. 2:04Storage tiering use cases
3. 4:33Erasure coding vs replication
4. 7:00ELECT design and contributions
5. 8:46Redundancy transitioning
6. 11:15Offline erasure coding
7. 13:44Hotness-aware thresholds
8. 16:29Experimental setup on Alibaba Cloud
9. 17:33Storage savings and performance
10. 19:40Recovery performance impact
11. 20:45Conclusion and Q&A

" related talks

• 01h 14mErasure Coding at ScaleMaxim Babenko · Hydra 2020
• 24mOpenEC: Toward Unified and Configurable Erasure Coding Management...Xiaolu Li · FAST '19
• 13mClosing the B+-tree vs. LSM-tree Write Amplification Gap on Modern Storage Hardware...Tong Zhang, Yang Liu, Yifan Qiao, Xubin Chen, Ning Zheng, Jiangpeng Li · FAST '22
• PolarStore: High-Performance Data Compression for Large-Scale Cloud-Native DatabasesJunwei Zhang, Junru Li, Feifei Li, Yuqi Zhou, Wenchao Zhou, Qingda Hu, Xinjun Yang, Ya Lin, Yicong Zhu, Rongbiao Xie, Ling Zhou, Bin Wu · FAST '26
• 18mPreview: KV-Stores and DatabasesAlex Conway · OSDI '21 / USENIX ATC '21
• 26mFast Erasure Coding for Data Storage: A Comprehensive Study of the Acceleration...Tianli Zhou · FAST '19
• 16mDEPART: Replica Decoupling for Distributed Key-Value StoragePatrick P. C. Lee, Yongkun Li, Yinlong Xu, Qiang Zhang, Si Wu · FAST '22
• 16mHolistic and Automated Task Scheduling for Distributed LSM-tree-based StoragePatrick P. C. Lee, Yongkun Li, Siyuan Sheng, Yuanming Ren, Zhang Cao · FAST '26