Stream Processing and Applications in the Modern Age

on YouTube ↗43m

" summary

Flink reports a unified runtime push (notably Flink 1.9 with ~190 contributors and ~2,000 commits) and demonstrates a new project, Stateful Functions (StateFun), that embeds local state in virtual function instances, implements messaging loops on top of Flink with an extension to support exactly-once checkpoints, and runs a concrete ride‑sharing demo (driver/passenger entities, geo‑index) as working code on GitHub under the Apache license and via statefun.io.

AI-written summary · about

" chapters (7)

1. 0:00Introduction and welcome
2. 4:24State of Flink community update
3. 9:01Stream processing applications overview
4. 19:41Introducing Stateful Functions
5. 31:17Ride-sharing demo and features
6. 36:03Project fit and use cases
7. 41:00Open source and future plans

" related talks

• 55mStateful Functions: Polyglot Event-Driven Functions for Stateful Distributed ApplicationsTzu-Li (Gordon) Tai · Flink Forward Virtual 2020
• 24mStateful Functions: Flexible like a Microservice, Consistent like a MonolithSeth Wiesman · Flink Forward Global 2021
• 34mHands-on Stateful Serverless Applications with Kubernetes and Stateful FunctionsSeth Wiesman · Flink Forward Global Virtual 2020
• 42mInterview and AMA with the creators of Stateful FunctionsSeth Wiesman, Stephan Ewen, Robert Metzger, Igal Shilman · Flink Forward Global Virtual 2020
• 35mApache Flink 2.0: Unified Enterprise Data Processing System and BeyondBowen Li · Scale By The Bay 2019
• 27mStateful Functions 3.0: Towards a Cross-Platform Stateful Serverless StackTzu-Li (Gordon) Tai · Berlin Buzzwords 2021
• 38mPolyglot Actor Model on Flink Stateful FunctionsTimothy Bess · Flink Forward Global 2021
• 37mKeynote | Flink Ahead: What Comes After Unified Batch & Streaming?Stephan Ewen · Flink Forward Global Virtual 2020