Reconstructing History with XTDB
summary
XTDB v2 is a temporal HTAP database released this year that exposes SQL 2011 valid/system time semantics, stores immutable transaction events in object storage and uses a single-partition Kafka log as the WAL, a JVM vectorized engine over Apache Arrow, and LSM compaction with a recency heuristic to avoid full historical materialization. Queries default to “valid as of now,” the engine plays events backward to build visible rows, and Postgres‑wire compatibility plus Metabase and Flight SQL support already work.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:06Auditing and history in databases
- 9:53Bitemporal models
- 18:25OLTP with temporal semantics
- 24:52XTDB transactional model
- 34:05XTDB storage and indexing
- 51:12Query optimization
- 1:00:09SQL extensions
- 1:03:17Q&A
related talks
32m"State of XTDB"
36mRicher SQL — Steering SQL's Future Towards Clojure's Philosophy
44mOpenTSDB - Time Series Schema on Schemaless NoSQL
42mAccessible Time Series data
36mHow Can HTAP Databases Simplify Your Data Infrastructure?
42mBack to the Future! Time Travel with Bitemporal Databases
18mTiFlash: Make TiKV 10x Faster and HTAP-able
41mRevisiting XTM: A Practical Case Study Highlighting Its Needs