TIPS: Making Volatile Index Structures Persistent with DRAM-NVMM Tiering

on YouTube ↗15m

" summary

TIPS is a framework that makes existing volatile index structures persistent by using DRAM-NVMM tiering and a UNO logging hybrid low-overhead log to guarantee crash consistency and fix persistent-memory leaks. It converts seven different concurrent indexes plus Redis without changing their concurrency code, provides durable linearizability via a tiered concurrency model, and evaluates with YCSB showing converted indexes outperforming PRONTO/NVTraverse/RECIPE and NVMM-optimized trees, hashes, and tries by 3–10×.

AI-written summary · about

" chapters (5)

1. 0:00Introduction
2. 2:54DRAM-NVMM tiering concept
3. 7:27Implementation tips
4. 12:10Performance benefits
5. 14:39Q&A

" related talks

• 17mPreview: Persistent MemoryIan Neal · OSDI '21 / USENIX ATC '21
• 30mZiggurat: A Tiered File System for Non-Volatile Main Memories and DisksShengan Zheng · FAST '19
• 43mPromise and Pitfalls of Persistent MemoryRob Dickinson · Strange Loop 2017
• 35mDeveloping Software for Persistent MemoryWillhalm Thomas · HighLoad++ 2015
• 16mAerospike + Intel® persistent memoryGinger Gilsdorf · Aerospike User Summit 2018
• 35mDeveloping Software for Persistent MemoryWillhalm Thomas · HighLoad++ 2015
• 06mEarly experience of Utilizing Persistent Memory for Database... (Work-in-Progress Report)Tsuyoshi Ozawa, Ryoji Kawamichi, Yuto Hayamizu, Kazuo Goda, Masaru Kitsuregawa · FAST '22
• 16mJohnny Cache: the End of DRAM Cache Conflicts (in Tiered Main Memory Systems)Willy Zwaenepoel, Baptiste Lepers · OSDI 2023