Plug Into Analytics Connecting ColumnStore to Source Databases with Spider Engine

on YouTube ↗27m

" summary

Live claim: ColumnStore + Spider engine lets an analytical cluster query live transactional sources without bulk ETL. The demo builds a tiny setup with Docker demo with Expand and a MariaDB server running ColumnStore and Spider, creates ODBC-backed Spider tables that point to an Expand cluster, then joins Spider and ColumnStore tables. Results: 30-row inserts validate the linkage, consolidated queries return 468 rows in ~2.5s and per-airline summaries (961,000+ rows in 2020) in under 0.6s.

AI-written summary · about

" chapters (10)

1. 0:00Intro
2. 2:26Supported Data Sources
3. 3:18Data Source: Xpand
4. 4:24Xpand Use Cases
5. 6:45Data Warehouse with Columnstore
6. 8:17Columnstore Use Cases
7. 10:44Connecting to sources
8. 13:41Demo Setup in Docker
9. 14:01Demo
10. 25:40Next Steps

" related talks

• 53mOptimizing your Azure SQL Database workloadsSanjay Mishra, Denzil Ribeiro, Dimitri Furman · SQLBits 2020
• 18mBuilding Data Lake with MariaDB ColumnStoreSasha Vaniachine · Percona Live Online 2020
• 49mAnalytics in SQL Server and Azure SQL Databasechuck heinzelman, Ajay Jagannathan · SQLBits 2023
• 50mADX and the last crusadeFrank Geisler · SQLBits 2023
• 27mBringing SQL to Aerospike and the Enterprise – Tony LiTony Li · Aerospike Summit 2022: Mission Now
• 32mDiscover the Modern Way to Build Real-Time Analytics Solutions at Any ScaleGolan Nahum, Ilya Gulman · hayaData 2024
• 42mColumnar Storage + Python: Powering Modern Data Science and AnalyticsRob Hedgpeth · Data Con LA 2021
• 30mBringing SQL to Aerospike and the Enterprise – Rick DeMareRick DeMare · Aerospike Summit 2022: Mission Now