Understanding stream table duality using Kafka, Flink SQL and Debezium format

on YouTube ↗27m

" summary

Shows how to get real-time Postgres CDC into Flink SQL via Kafka using Debezium JSON/Avro format, builds a Docker testbed and proves continuous queries update as changes arrive, including insert update_before update_after and delete events, and a Group By sum that moves Bob’s total 10 → 30 → 10 in the demo. Explains change-log modes: +I, update_before, update_after, -D and how watermarks/windows or Flink CDC connectors trigger table-to-stream and stream-to-table conversions.

AI-written summary · about

" chapters (6)

1. 0:00Introduction to stream table duality
2. 3:49Stream table transformations explained
3. 11:40Streaming SQL with Apache Flink
4. 15:19Change data capture with Debezium
5. 16:43Live demo setup and execution
6. 25:11Flink CDC and conclusion

" related talks

• 43mContinuous SQL with Kafka and FlinkTimothy J Spann · JCON WORLD ONLINE 2023
• 30mChange Data Capture With Flink SQL And DebeziumMarta Paes · DataEngBytes 2020
• 39mChangelog Stream Processing with Apache FlinkTimo Walther · Berlin Buzzwords 2022
• 35mFlink's Table & DataStream API: A Perfect SymbiosisTimo Walther · Flink Forward Global 2021
• 42mFlinkCDC: Streamlining your data analytics pipelinesMuhammet Orazov · Berlin Buzzwords 2025
• 46mFlink SQL in 2020: Time to show off!Timo Walther, Fabian Hueske · Flink Forward Virtual 2020
• 03h 00mStream Processing, Going Beyond Pub/Sub with Kafka Streams and...F. Ramière, D Petisme · Devoxx France 2021
• 01h 11mChange data capture pipelines with Debezium and Kafka StreamsGunnar Morling · Joker 2020