Real-Time Data Streaming with Azure Stream Analytics
summary
Shows a working pipeline: Raspberry Pi sends JSON sensor events into Event Hubs, Azure Stream Analytics runs select into output from input queries, calls a C# UDF to convert Celsius to Fahrenheit, writes to Power BI and a Service Bus queue, and triggers Logic Apps; the demo actually streams live and renders dashboards. Notes cost and options: 11 cents an hour per streaming unit versus Databricks $8 an hour, and Azure ML integration is available but still maturing.
AI-written summary · about
chapters (17)
- 0:00Introduction
- 0:26About me
- 1:04Agenda
- 1:56What is realtime stream processing
- 3:07What is a realtime stream
- 3:54Batch vs realtime stream processing
- 4:58Technologies
- 8:19Data Egress
- 11:17Temporal Windows
- 13:50Temporal Sequel
- 16:55RealTime Analytics
- 18:13Open Source Approach
- 19:03Azure ML Service
- 20:50Raspberry Pi
- 22:52Data Structure
- 24:11Local Input
- 27:57Running the Job
related talks
01h 21mStructured Streaming with PySpark and Azure Databricks
50mBest practices for implementing a modern data architecture with Azure
24mHands-on Practice
45mLogging, Instrumentation, Dashboards and Alerts - for Developers
43mTurn your logs into actionable data at any scale with AWS
45mThe data runway: Soaring to New Heights with Fabric Data Activator
07mOptimizing Data Pipelines with Azure Data Factory
56mDataDevOps for the Modern Data Warehouse on Microsoft Azure