TiFlash: Make TiKV 10x Faster and HTAP-able
Talkat KubeCon + CloudNativeCon North America 2020 Virtual · on Friday, 2020-11-20· at 16:00· Intrado Virtual Event Platform,·
summary
Adds a columnar engine called DeltaTree (inspired by ClickHouse) to TiKV/TiDB, implementing real‑time updatable, append‑then‑compact column segments to avoid LSM multi‑way merges and speed scans. Replication uses raft learner replicas that do not vote, replicate directly from TiKV leaders, and consult leader replication progress so reads can wait for a consistent index; timestamps and VCC provide snapshot isolation. Benchmarks on the OnTime dataset and a Xiaohongshu migration show typical 3–10x speedup and up to 20x on long queries, and production deployment reports improved analytic isolation.
AI-written summary · about
chapters (6)
- 0:00Introduction
- 0:15Why to make TiKV 10x Faster
- 6:23TiFlash
- 9:43Columnar Storage
- 14:11Consistency
- 16:03Performance
related talks
11mAdapting TiKV for Cloud Storage
29mDistributed SQL How TiDB Modernized Data Management
24mUsing a Distributed Key-Value Store
47m10 Reasons Why the TiDB Database Should Power Your Next Development Project
40mTiKV Best Practices
29mHow We Make TiKV- a Distributed Storage, More Cost-Effective On the Cloud
36mHow Can HTAP Databases Simplify Your Data Infrastructure?
01h 13mHTAP made live — from the engineering perspective