Serverless Azure Data handling

on YouTube ↗01h 01m

" summary

Shows a serverless data pipeline built on Azure Functions, Storage queues and an Azure SQL serverless database that actually scales out to parallel instances (example: 1,000 song IDs cause ~20 concurrent function workers) and avoids API timeouts by fanning out work and paginating via queues. Uses storage queues for fan‑out, durable entities (backed by storage tables) for state, and compares consumption vs premium billing and SQL auto‑pause/min‑max vCores. Demo runs end‑to‑end and highlights cold‑start retries, App Insights cost, and 1M free function executions.

AI-written summary · about

" chapters (12)

1. 0:00Introduction and session setup
2. 3:53What serverless really means
3. 9:51Serverless services in Azure
4. 16:57Advantages of serverless for data
5. 23:26When to use serverless in data handling
6. 27:41State management in serverless
7. 31:54Demo Azure Functions setup
8. 38:37Azure Functions triggers and use cases
9. 44:25Data processing demo with Azure Functions
10. 51:08Serverless SQL database explained
11. 56:53Logic Apps for data workflows
12. 59:05Q&A and closing remarks

" related talks

• 51mServerless – are you ready for the revolution?Michał Jankowski · HighLoad++ Moscow 2018
• 39mIntroducing Azure Functions for serverless .NETCarl in 't Veld · Future Tech 2019
• 01h 00mServerless Trends of the SeasonNandeesh Swami · AzConf 2020
• 46mBuild serverless, full stack applications in Azure with Azure SQLAnna Hoffman · Women Data Summit 2021
• 42mServer-less compute with .NET based Azure FunctionsAlex Thissen · .NET fwdays'18
• 48mServerless Architecture in AzureRob Richardson · DevOpsDays Chicago 2017
• 01h 01mServerless Architecture With AzureWong Kah Wai · Global Azure Virtual 2020
• 14mOvercoming Serverless challenges with Durable FunctionsAnthony Chu · Microsoft Create: Serverless 2020