Stream Processing and SQL

on YouTube ↗21m

" summary

Shows how extending SQL for streams enables continuous queries over unbounded data using concrete windowing and join semantics. Demonstrates using Apache Calcite for parsing/planning and adapters, with execution on Flink and Kafka as the source, including examples like SELECT STREAM * FROM events, TUMBLE/HOP windows, stream–table joins, and aggregations emitted every five seconds with a live demo of updated counts.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 1:01Streaming data definition
3. 2:04Use SQL with streaming
4. 3:50Classic vs streaming SQL
5. 6:15Streaming frameworks & Calcite
6. 8:10Enriching SQL for streaming
7. 12:35Flink demo
8. 15:45SQL benefits
9. 17:15AthenaX streaming
10. 19:25Future of streaming & SQL

" related talks

• 41mStreaming SQLJulian Hyde · Flink Forward Berlin 2016
• 43mUnified stream and batch processing with Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2017
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Berlin Buzzwords 2021
• 42mStream Processing with Apache FlinkTugdual Grall · DevFest Toulouse 2017
• 31mWriting a Streaming SQL & Materialized View EngineKenny Gorman · Flink Forward Virtual 2020
• 08mPREVIEW: Kafka Stream Processing for Everyone with KSQLNick Dearden · Kafka Summit San Francisco 2017
• 23mFrom Streams to Tables and Back Again: A Demo of Flink’s Table & SQL APITimo Walther · Flink Forward Berlin 2017
• 40mOne SQL to Rule Them AllFabian Hueske · Flink Forward Europe 2019