Change Data Capture: Exploring YugabyteDB’s Modern Design

on YouTube ↗22m

" summary

YugabyteDB implements CDC by reading per-tablet WAL files (LSM-based) and exporting ordered changes into Kafka via a custom Kafka Connect connector; it creates a stream id per database, stores checkpoints inside Yugabyte using the WAL’s op id, and supports initial snapshots plus configurable task parallelism. The system guarantees at-least-once delivery, maps tables to Kafka topics by default, and the demo shows inserts, updates and deletes flowing from Yugabyte into Kafka and onward to a Postgres sink successfully.

AI-written summary · about

" chapters (5)

1. 0:00Introduction
2. 1:55Solutions
3. 4:24Transaction Logs
4. 7:32CDC
5. 16:35Demo

" related talks

• 39mDeep Dive on Using YugabyteDB's Change Data Capture ConnectorBalachandar Seetharaman · Distributed SQL Summit Asia 2023
• 18mData Modernization Using Confluent and YugabyteAnanda Bose · Distributed SQL Summit Asia 2022
• 31mMake it Painless: YugabyteDB Database Migration SolutionsNadeem Khan · Distributed SQL Summit Asia 2025
• 35mChange Data Capture: The Magic Wand We Forgot #bbuzzMartin Kleppmann · Berlin Buzzwords 2015
• 20mChange Data Capture in Distributed SystemsPetr Zapletal · Scale By The Bay 2019
• 01h 09mOpen-source Change Data Capture With DebeziumGunnar Morling · Vaccination Database Tech Talks (Booster) - Spring 2022
• 22mMigrating from Monolithic to Cloud Native Distributed SQL Database with Zero DowntimeSUHENDRA AHMAD · Distributed SQL Summit Asia 2022
• 15mScaling PostgreSQL Change Data Capture Using Open Source AirbyteRodi Reich Z · Postgres Conference Orlando 2025