Declarative stream processing...

on YouTube ↗39m

" summary

Apache Flink claims to run both low-latency pattern detection and high-throughput analytics on the same engine by adding a CEP library and a StreamSQL / Table API that compile via Calcite into optimized DataStream programs. Patterns become a non-deterministic automaton executed in an operator, CEP emits success or timeout warning events which can be registered as tables and aggregated with tumbling/sliding windows, and the system relies on event-time with watermarks and exactly-once semantics; pattern-in-SQL is a proposed extension, not yet finished.

AI-written summary · about

" chapters (7)

1. 0:00Introduction to stream
2. 6:45Tracking an order process
3. 9:06Streaming analytics basics
4. 16:44Complex event processing
5. 23:57Integrating CEP and SQL
6. 24:14Future visions and Q&A
7. 36:47Closing thoughts

" related talks

• 38mStreaming analytics and CEP ... #bbuzzTill Rohrmann, Fabian Hueske · Berlin Buzzwords 2016
• 33mComplex Event Processing with Flink: the state of FlinkCEPKostas Kloudas · Flink Forward Berlin 2017
• 41mBeyond the Hype: When Apache Flink Solves Real ProblemsNaci Simsek · Berlin Buzzwords 2026
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016
• 39mChangelog Stream Processing with Apache FlinkTimo Walther · Berlin Buzzwords 2022
• 42mStream Processing beyond Streaming DataStephan Ewen · ITNEXT Summit 2019
• 49mscale.bythebay.io: Stephan Ewen, Apache Flink and the Next Wave of Stream Processing ApplicationsStephan Ewen · Scale By the Bay 2017
• 45mData Stream Processing Concepts and ImplementationsMatthias Niehoff · Devoxx Belgium 2017