Process large-scale data and computational function in serverless manner
summary
Claims that Azure Synapse serverless SQL pool makes large-scale COVID and supply-chain analysis possible without provisioning clusters, using Bing/European/Kaggle open datasets and Power BI connectors. Pipeline converts CSV/JSON to Parquet and <10GB files for performance, queries use OPENROWSET and external tables, and jobs auto-scale on demand — billed only when queries run. Notable figures shown: 175 gab bytes world data and ~500M tweets/day and ~300% annual data growth; prototypes produce per-country and per-district spike forecasts feeding resourcing decisions.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 0:53Big Data
- 2:13Current Situation Diagram
- 3:55Information
- 5:24Data Source
- 8:01Challenges
- 10:16Strategy
- 12:04Components
- 14:23Why SQL on Demand
- 18:08Querying Data
- 19:41Data Analysis
- 26:44Best Practices
related talks
52mImplement a Serverless Data Analytics strategy
58mAzure Data Lake & Synapse Server less Architecture
21mA low cost serveless synapse data platform
49mAzure Synapse Analytics
01h 01mServerless Azure Data handling
47mImplement a Serverless Data Analytics strategy with Microsoft Azure
50mPower BI + Azure Synapse Analytics: Beginning your journey
43mImplement a Serverless Data Platform with Microsoft Azure