DuckCon #4
who it's for
data engineers, analytics engineers, machine learning engineers, platform engineers, database engineers, notebook developers
topics
Parquet file processing; CSV ingestion performance; DuckDB WASM in browser; full-text search with FTS; Delta and Iceberg merges on S3; Arrow integration and Arrow I/O; embedded DuckDB planner library; HNSW vector search with DuckDB filters; Protobuf to Parquet ETL pipelines; custom DuckDB extensions and aggregations
| title | author | length |
|---|---|---|
| State of the Duck | Hannes Mühleisen, Mark Raasveldt | 23m |
Release v0.10.0 ships within weeks and the project plans a snow‑leopard style v1.0 focused on stability, backed by 5 million extension installs/month and about… | ||
| Hugging a Duck: Democratizing Data Access and Exploration with DuckDB and Hugging Face Hub | Polina Kazakova | 15m |
Hugging Face converts each public dataset to Parquet (up to first 5 GB), adds an index.ddb file containing a DuckDB database and full‑text index, and exposes… | ||
| Building Data Lake Using DuckDB | Subash Roul | 26m |
A managed data lake pipeline that uses DuckDB per Kubernetes pod to perform distributed Parquet rewrites and CDC-style merges into Iceberg/Delta on S3 and ADLS… | ||
| The Duck(DB) Feather in Your Parquet Cap | Niger Little-Poole | 21m |
Company uses DuckDB in production since 0.41 to inspect Parquet files via duckdb parquet_schema and parquet_metadata, generate manifests, and emit SQL-based… | ||
| DuckDB Powering Interactive Notebooks | Rik Bauwens | 05m |
Embeds DuckDB into a notebook product so a SQL cell can query Redshift and return results directly into a pandas DataFrame, and a DataFrame/CSV source can be… | ||
| DuckDB Applications in Information Retrieval | Arjen de Vries | 06m |
DuckDB ingests Protobuf/Parquet web-index dumps from the Open Web Search project and turns them into queryable tables in days rather than months, with… | ||
| How to Analyse a DDoS Quackly | Remco Poortinga – van Wijnen | 05m |
A DuckDB-based packet dissector replaces an in-memory pandas/DataFrame pipeline with on-disk Parquet processing and produces JSON “fingerprints” of DDoS attack… | ||
| Building Tecton’s Feature Engineering Platform on DuckDB | Mike Eastham | 05m |
Tecton replaces Spark with DuckDB and Arrow-based pipelines to compute feature values, store them in Delta Lake, and export training sets; jobs for many… | ||
| nothing matches | ||