Event-Driven Change Data Capture pattern
summary
Claim: an event-driven CDC pattern built on Apache Pulsar captures DB changes as ordered logs, transforms them with Pulsar functions, and reliably streams to downstream targets. The demo shows enabling CDC for Astra DB (Cassandra), creating a streaming tenant, and syncing to Elasticsearch; storage uses BookKeeper for replay and cold-to-S3 offload. Guarantees include delivery semantics and ordering, and deployment options are managed Astra Streaming or self-hosted Luna Streaming. Free tiers ($25/month) and a $200 promo are available for hands-on testing.
AI-written summary · about
chapters (10)
- 0:00Event-driven CDC with Pulsar
- 4:29Introduction
- 10:10ETL to CDC evolution
- 13:25Modern CDC system components
- 17:16Log-based vs polling and triggers
- 23:16Event-driven architecture for CDC
- 23:36Apache Pulsar features
- 29:18CDC for Astra DB with Pulsar
- 33:36Demo and resources
- 35:22Q&A
related talks
50mEvent-Driven Change Data Capture using Apache Pulsar
46mEvent-Driven Change Data Capture Pattern Using Apache Pulsar
30mChange Data Streaming Patterns in Distributed Systems
36mChange Data Streaming Patterns for Distributed Systems
35mImplementing CDC with change feed
14mHow not(!) to build real-time apps
41mStreaming your database - Easier said than done?
43mBack to fundamentals: from databases to event-driven platforms