Building Data Lake with MariaDB ColumnStore

on YouTube ↗18m

" summary

Claims that MariaDB ColumnStore plus S3 storage cuts storage costs and delivers substantial compression while accelerating wide scans and aggregations by orders of magnitude compared with the OLTP engine. Demonstrates MySQL‑client access (ODBC/JDBC) and Jupyter integration, moves data via readonly snapshots plus delta extracts with minimal transformation, and surfaces practical gotchas: schema string defaults, unsupported column types, and tuning knobs required to reach advertised performance.

AI-written summary · about

" chapters (8)

1. 0:00Data lakes and analytics
2. 2:16ColumnStore for analytics
3. 4:52Row vs ColumnStore performance
4. 7:31Data transfer challenges
5. 10:07Handling data types
6. 12:36Setup considerations
7. 14:44ColumnStore in cloud
8. 16:35New features and future

" related talks

• 17mUsing MariaDB ColumnStore with Power BI for Visualization and ReportingTodd Stoffel · MariaDB OpenWorks 2023
• 42mColumnar Storage + Python: Powering Modern Data Science and AnalyticsRob Hedgpeth · Data Con LA 2021
• 58mIntroducing ScaleDB, the New Clustered, Distributed Storage Engine for MySQL (Part 1)Ivan Zoratti · Percona Live Open Source Database Conference 2017
• 37m"Charge Up" or CDC from MariaDB and Postgres into MariaDB Columnstore AnalyticsRoman Nozdrin · HighLoad++ Moscow 2018
• 41mHTAP with MariaDB PlatformTodd Stoffel · Data Con LA 2019
• 25mThe future of databases: Combining operational and analytical data at massive scaleRob Hedgpeth · Big Data & AI Toronto 2021
• 27mPlug Into Analytics Connecting ColumnStore to Source Databases with Spider EngineKathryn Sizemore · MariaDB OpenWorks 2023
• 41mMariaDB The New MySQLColin Charles · HighLoad++ 2012