SQL 2022 and S3 – Dell’s overview of consuming object data via Microsoft SQL
summary
Demo uses SQL Server 2022 with PolyBase against Dell ECS object storage and an S3 browser, creating database-scoped credentials and external data sources to expose CSVs (1M and 5M rows) and a CTAS job that writes 200 million rows into sharded Parquet files. Queries join Parquet to relational tables and return results in seconds (examples: 4–10s for CSV joins, ~34s for a heavy group-by join), and backups/restores write to S3 URLs successfully. Key commands: create external table as select, S3 backup/restore, database-scoped credential.
AI-written summary · about
chapters (10)
- 0:00Start
- 0:40Robert Sonders
- 1:22Rob... In his spare time
- 4:04Distributed File Systems and Object Storage Leadership
- 4:51Data virtualization and object storage Directly access any data on object storage
- 6:19ECS management
- 9:59Microsoft SQL Analytics Physical Architecture
- 40:00Using REST API based data virtualization
- 40:21SQL 2022 S3 Use Case
- 47:12Continued learning
related talks
51mData tiering using data Virtualization in SQL
21mThe Power of Polybase with SQL - True data Virtualisation
49mAnalytics in SQL Server and Azure SQL Database
28mServerless Data Analysis and Reporting using SQL
41mOwning Your Own (Data) Lake House
28mThe architecture behind modern cloud data warehouses
34mBest Practices for Implementing a Data Lake in Amazon S3
21mSQL Server 2022 – Time to Rethink your Backup and Recovery Strategy