mnesia + leveldb (...)
summary
mnesia_ext lets mnesia plug arbitrary storage engines so Klarna migrates parts to LevelDB and plugs it via a 3k-line back end and a LevelDB manager for fast snapshot backups using hardlinks. Claim: node restarts drop (one table restart 4m40s faster), huge disk shrink (XML store ~300GB → ~70GB, packs 600GB → 40GB), less RAM pressure, and LevelDB runs in production a year with no data corruption.
AI-written summary · about
chapters (27)
- 0:00Intro
- 0:24Background
- 0:59Benefits
- 3:01mnesia
- 5:16overview
- 8:00discovery copies
- 9:08table size
- 11:28dis copies
- 13:33ram copies
- 15:43summary
- 16:16leveldb
- 18:55top level
- 20:03right buffer
- 21:36compaction
- 24:24read
- 28:58in development
- 30:42backend module
- 32:33secondary index
- 33:31migrations
- 35:35Berkeley DB
- 36:22Migration
- 38:07Pack files
- 39:11Disk copies
- 40:17Backups
- 41:29Snapshots
- 42:57Improvements
- 44:44Debts
related talks
37mBreaking up with Mnesia
24mA Real Database Rethink, Introducing LevelDB and NodeJS
29mSLM-DB: Single-Level Key-Value Store with Persistent Memory
12mSpanDB: A Fast, Cost-Effective LSM-tree Based KV Store on Hybrid Storage
48mThe LMDB Engine — a Special Champion
22mA Modular Database?
40mKhepri - Mnesia replacement
52mData storage for modern applications - Mike Lehan