Building a Kubernetes Operator for Apache Flink in Java

on YouTube ↗22m

" summary

Concrete how-to for running Flink on Kubernetes: shows building the official Flink Kubernetes Operator in Java using Java Operator SDK and the Fabric8 client, with CRD named FlinkDeployment that encodes image/version, taskmanager/jobmanager, and job config. Operator automates lifecycle, periodic savepoints, stateful upgrades (clean shutdown, restore), events and status fields for live monitoring, finalizer/cleanup handled by the SDK, Quarkus extension supported; project is production-used with ~10–12 stable releases since open sourcing ~2 years ago.

AI-written summary · about

" chapters (4)

1. 0:00Introduction
2. 7:20Kubernetes Operators overview
3. 14:42Flink operator specifics
4. 20:16Q&A

" related talks

• 42mManaging Apache Flink on Kubernetes - FlinkK8sOperatorAnand Swaminathan · KubeCon + CloudNativeCon North America 2019
• 26mKubernetes & real-time analytics: How to connect these worlds with Apache FlinkAlbert Lewandowski · Berlin Buzzwords 2021
• 44mLets Deeploy Flink - Uncovering Hidden Depths of Yarn, Docker, Kubernetes & BeyondNaci Simsek · Big Data Conference Europe 2025
• 31mWriting a Kubernetes Operator in JavaFabian Stäber · Devoxx Belgium 2019
• 18mBuilding a Kubernetes Operator in QuarkusFabian Lange · AWS re:Invent 2019
• 33mFlink in ContainerlandPatrick Lucas · Flink Forward Berlin 2017
• 43mCreating a Kubernetes Operator in JavaRudy De Busscher · JCON 2020
• 24mKeynote: The Easiest Way to Get Operational With Apache FlinkKonstantin Knauf · Flink Forward Virtual 2020