Stream Processing with Apache Flink

on YouTube ↗42m

" summary

Apache Flink’s streaming‑first Java/Scala API for distributed deployment (standalone, YARN, Mesos, cloud) and integrations with Kafka, HDFS and HBase is presented, with state persisted to distributed filesystems or RocksDB. A live socket word‑count demo illustrates sliding windows and stateful aggregation; production use cases include Bouygues Telecom processing 10 billion messages/day and CEP rules (e.g. order→shipment within one hour) with event‑time windows and exactly‑once state management to trigger alerts.

AI-written summary · about

" chapters (10)

1. 0:00Start
2. 0:47Apache Flink
3. 0:58Big data
4. 7:03Batch processing
5. 7:22Apache Kafka
6. 8:22Database
7. 10:50Hadoop
8. 14:08Apache Spark
9. 18:53Machine learning
10. 21:34Complex Event Processing

" related talks

• 51mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Voxxed Days Ticino 2025
• 37mStateful Stream Processing with Apache Flink 1.5 and beyondNico Kruber · Berlin Buzzwords 2018
• 21mStream Processing and SQLBruno Bonnin · ScalaIO 2018
• 43mUnified stream and batch processing with Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2017
• 41mStream Processor as a Database: Building Online ApplicationsStephan Ewen · Berlin Buzzwords 2016
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Berlin Buzzwords 2021
• 29mApache Kafka and the Next 700 Stream Processing SystemsJay Kreps · Strange Loop 2015
• 40mThe Seven Deadly Sins of StreamingGiannis Polyzos · Big Data Conference Europe 2025