A Year in Flink: The Most Important Changes in Recent Versions

on YouTube ↗37m

" summary

The talk reviews the last year of Apache Flink development, covering three major releases that added about 7,000 commits and 3,000 fixed issues. It describes concrete features: batch–stream unification (one execution path for bounded and unbounded jobs), a new Source API and expanded connector ecosystem (better Iceberg and community connectors), stateful Python UDF support, richer SQL window and temporal functions, improved checkpointing and changelog semantics (including floating/minor checkpoints), and reactive/active mode for TaskManager autoscaling plus enhanced operational metrics and clearer failure semantics.

AI-written summary · about

" chapters (5)

1. 0:00Apache Flink in 2021
2. 1:50Batch - Streaming Unification
3. 11:05SQL
4. 17:56Connectors
5. 22:42Operations & Observability

" related talks

• 37mThe Future of Apache FlinkAljoscha Krettek · Flink Forward Berlin 2016
• 37mKeynote | Flink Ahead: What Comes After Unified Batch & Streaming?Stephan Ewen · Flink Forward Global Virtual 2020
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016
• 31mA Year in Flink - Flink SQL Live CodingNico Kruber · Flink Forward Global Virtual 2020
• 41mBeyond the Hype: When Apache Flink Solves Real ProblemsNaci Simsek · Berlin Buzzwords 2026
• 42mApache Flink deep-dive #bbuzzStephan Ewen · Berlin Buzzwords 2015
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · DataEngBytes 2021
• 43mLeverage the power and simplicity of SQL on Apache FlinkFabian Hueske · Berlin Buzzwords 2018