Deliver In-flight stream processing with Apache Flink on Azure

on YouTube ↗07m

" summary

Confluent Cloud for Apache Flink runs as a fully managed service on Azure Marketplace and demonstrates live stream processing: an automated masking IP addresses action creates a new Kafka topic with masked clickstream events, a JavaScript size-comparison function is packaged as a JavaScript UDF in a JAR and registered for Flink SQL, a continuous query populates a table and performs a temporal join to surface specific brands whose shirts are consistently returned for being too small, and the demo shows the pipeline executing and identifying offending brands in real time.

AI-written summary · about

" chapters (6)

1. 0:00Introduction to stream processing
2. 1:05Data masking with Flink
3. 2:28Defining custom logic
4. 3:32Analyzing order patterns
5. 4:28Identifying problematic brands
6. 5:05Conclusion and resources

" related talks

• 43mA Data Streaming Architecture with Apache Flink #bbuzzRobert Metzger · Berlin Buzzwords 2016
• 34mBeaming Flink to the Cloud @ NetflixMonal Daxini · Flink Forward Berlin 2016
• 49mscale.bythebay.io: Stephan Ewen, Apache Flink and the Next Wave of Stream Processing ApplicationsStephan Ewen · Scale By the Bay 2017
• 41mBeyond the Hype: When Apache Flink Solves Real ProblemsNaci Simsek · Berlin Buzzwords 2026
• 25mOnly SQL: Empower data analysts end-to-end with Flink SQLMartijn Visser · Flink Forward Global 2021
• 40mFrom concept to production; the fastest way to develop & deploy Apache Flink jobsSteffen Hausmann, Danny Cranmer · Flink Forward Global 2021
• 50mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Jfokus 2025
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016