Scanning the skies above SQLBits - Realtime streaming of flight data with Microsoft Fabric
summary
A working end-to-end demo streams ADS‑B transponder data from a Raspberry Pi + FlightAware software into Fabric’s Eventstream, writes into a KQL database (hundreds to 722 rows in minutes, ~0.5 billion in long run), and visualizes live aircraft on Power BI with 5‑second page refresh using DirectQuery. KQL ranks per‑aircraft points for ordered flight paths, an H3 hexagon aggregation shows traffic density, and Data Activator reflexes fire alerts on emergency flags — all assembled and running live.
AI-written summary · about
chapters (13)
- 0:00Realtime flight data streaming
- 1:12Event stream in Microsoft Fabric
- 2:59Flight data source setup
- 5:33Streaming with .NET app
- 8:23Flight data in KQL database
- 13:24Power BI visualization prep
- 17:02Power BI to KQL connection
- 21:19Map flight paths and icons
- 30:22Dynamic time parameters
- 33:33Real-time Power BI updates
- 35:04Flight traffic patterns analysis
- 39:48Alerts with Data Activator
- 42:58Summary and Q&A
related talks
42mReimagine Real-Time Intelligence with Microsoft Fabric
37mJoin this live flight tracking demonstration on event enabling API's
24mLeveraging the Apache Flight Python Client and InfluxDB
55mTracking Aircraft with Redis & Software-Defined Radio
29mFighting financial crime: How Kinectify uses Azure Cosmos DB, Fabric, and Azure AI to stop money...
01h 05mKeynote: Building Applications with the Modern SQL Using AI and Microsoft Fabric
57mTaming IoT Data: Making Sense of Sensors with SQL Streaming
30mDataEngBytes 2023 - BRI-T1-04 - Mimoune Djouallah