Azure Data Explorer - a Torch in the Dungeon of Observational Analytics

on YouTube ↗51m

" summary

Azure Data Explorer (Kusto) is a managed columnar service for high‑frequency, semi‑structured and free‑text logs with built‑in compression, full‑text indexing and continuous ingestion from Event Hub, Kafka, ADLS and blobs. Queries use KQL (pipe syntax, regex, parse, scan, series_decompose and forecast) and run sub‑second on large sets — examples show 1.2 billion records and a 40 TB dataset, an 800 million‑row day query finishing in under two seconds. There is a free 100 GB cluster, a Power BI connector and optional SQL compatibility.

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 2:11Necessity is the Mother of Invention
3. 6:53Introducing Azure Data Explorer aka Kusto!
4. 9:06Architecture
5. 43:55Scenarios for Azure Data Explorer
6. 47:39Azure Data Explorer Community Resources

" related talks

• 44mContextualizing timeseries data with graphsDevang Shah, Henning Rauch · SQLBits 2024
• 49mCome see your SQL Perfmon in the cloudBob Ward, Dimitri Furman · SQLBits 2024
• 59mAnalyzing StackExchange data with Azure Data LakeTom Kerkhove · NDC Sydney 2017
• 55mAzure SQL database, Azure Synapse Analytics, Azure Databricks?Dinesh Kumar · Global Azure Virtual 2021
• 46mDiscover Oracle Database@Azure a new opportunity for developersKambiz Aghili, Marty Gubar, Kalyan Kaki, Gavin Parish · Microsoft Build 2024
• 01h 02mAnalyzing StackExchange with Azure Data LakeTom Kerkhove · NDC Minnesota 2018
• 14mPower real-time data streams from anywhere to Cosmos DB with ConfluentFlorence Sullivan · Microsoft Build 2023
• 47mImplement a Serverless Data Analytics strategy with Microsoft AzureRoberto Freato · DevDays Europe 2022