Motherduck: Data Analytics in the Post Big-Data Era
summary
Claim: Big data is dead — most queries touch <1GB and recent data, so design shifts from massive scale-out clusters to local-first analytics. Demonstrations show DuckDB running billion‑row queries on laptops faster than a cloud warehouse; MotherDuck wraps DuckDB with a cloud storage layer, hybrid execution that ships only needed plan fragments and moves work between laptop and cloud, and a scale up not out Kubernetes deployment with per‑user DuckDB instances for concurrency. Supports Parquet/Iceberg on S3, DBT and Hex integrations; reduces cloud cost and latency.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 3:31Big Data is dead
- 8:07Laptops are powerful
- 10:34Scale-up is viable
- 13:01What is DuckDB and why it matters
- 17:39MotherDuck introduction
- 23:50Hybrid query execution
- 28:04Scale-up cloud analytics
- 31:56DuckDB as data warehouse
- 34:45Data analytics trends
- 37:15Q&A
- 39:44Q&A
- 42:13Q&A
- 46:46Q&A
- 49:14Q&A
related talks
38mFrom Big Data to DuckDB: Ryan Boyd (MotherDuck) on Hyper-Tenancy, Duck Lake, and Making Data Fun.
24mData infrastructure to build bigger with less
36mMotherDuck
27mMotherDuck: Taking flight with interactive analytics
27mThe Duck and the DataFrame: A Data Engineer’s Journey with DuckDB
01h 02mAnalytics for not-so-big data with DuckDB
33mDataEngBytes 2023 - SYD-T1-01 - Ryan Boyd
28mAnalyze data easily with duckdb - and the implications on data architectures