Developing Software for Persistent Memory

on YouTube ↗35m

" summary

NVDIMMs and new persistence instructions from Intel let code access RAM that survives reboots, and experiments simulate latency: scans with a prefetcher double latency but only drop throughput ~7%, while a B+ tree sees ~37% loss. A prototype database (simulated PM) shows a full recovery around 8 seconds, moving critical indexes into PM cuts recovery by ~2 seconds and full-PM gives near-instant recovery (sub-5 ms) for many operations. Hardware claims include up to ~6 TB per two-socket server, and use requires cache flush/fence sequences or PM libraries.

AI-written summary · about

" chapters (6)

1. 0:00Introduction to persistent memory
2. 5:53Advantages of new memory technology
3. 13:01Paradigm shift in memory usage
4. 19:39Prototyping databases with persistent memory
5. 28:53Future of persistent memory development
6. 30:24Q&A session

" related talks

• 43mPromise and Pitfalls of Persistent MemoryRob Dickinson · Strange Loop 2017
• 17mPreview: Persistent MemoryIan Neal · OSDI '21 / USENIX ATC '21
• 06mEarly experience of Utilizing Persistent Memory for Database... (Work-in-Progress Report)Tsuyoshi Ozawa, Ryoji Kawamichi, Yuto Hayamizu, Kazuo Goda, Masaru Kitsuregawa · FAST '22
• 52mByte-Addressable Persistent Memory and DBMSAndrey Nikolaenko · Tarantool Conference 2018
• 17mBreakthrough Data-Centric Computing with a New Memory TierAlper Ilkbahar · Aerospike Virtual Summit ’20
• 16mAerospike + Intel® persistent memoryGinger Gilsdorf · Aerospike User Summit 2018
• 30mLarge-Scale Practice of Persistent Memory in Alibaba CloudQingcan Wang, Junbao Kan · KubeCon + CloudNativeCon North America 2021
• 20mRevisiting Secondary Indexing in LSM-based Storage Systems with Persistent MemoryYuhao Zhang, Jing Wang, Jiwu Shu, Youyou Lu, Qing Wang · USENIX ATC '23