SQL Server 2019 Big Data Clusters Architecture
summary
Explains how SQL Server 2019 Big Data Clusters actually run as containerized SQL Server instances and Spark pods on Kubernetes, with a control plane, config store, Grafana/Kibana monitoring, and HDFS-backed storage; demos show querying millions of CSVs in-place via PolyBase external tables, moving data into relational data pools, training Spark ML models and exporting tiny models to SQL Edge for device inference; shows it works end-to-end on a single-node dev cluster and scales to multi-node deployments.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 2:00What is Big Data
- 6:25Scale Out
- 12:15Virtualize
- 14:55Containers
- 19:44Kubernetes
- 23:37Demo
- 28:49Azure Data Studio Demo
related talks
25mSecure Large-Scale Data Analysis and AI with Polyglot Data Sources
57mSQL Server Containers & Kubernetes - Going to Production!- 57mSQL Server Containers & Kubernetes - Going to Production!
47mPods & Pages: Databases in Kubernetes
24mDynamic Big Data in the Cloud with Kubernetes
43mAnalyzing Big Data in Azure cloud using Spark and Databricks
26mRe-architecting the Data Platform with Spark on Kubernetes
22mExploring Cloud Native Big Data Platform in SPDB