DuckCon #2 2023
2023-02-03
Brussels, Belgium
who it's for
data engineers, analytics engineers, platform engineers, streaming engineers, machine learning engineers, extension developers
topics
DuckDB extensions system; ART indexes for storage; out-of-core hash join; parallel bulk loading; S3-distributed extension binaries; WebAssembly transforms in pipeline; Arrow Flight zero-copy streaming; browser-embedded DuckDB for previews; HDFS parquet connector; parquet footer-aware sampling; serverless cloud duckling caching; training-data point-in-time joins
| title | author | length |
|---|---|---|
| State of the Duck | Mark Raasveldt, Hannes Mühleisen | 45m |
Progress report on storage, execution, and adoption: the project ships persistent ART indexes, parallel bulk loading and many new compression codecs that… | ||
| DuckDB Extensions | Pedro Holanda, Sam Ansmink | 18m |
Extension system lets DuckDB stay tiny while adding features as separate modules: extensions install and load as shared libraries, CI builds platform-specific… | ||
| MotherDuck | Boaz Leskes, Yves Maout | 36m |
MotherDuck runs DuckDB as a hybrid local/cloud system that keeps most work on the laptop while spinning a cloud-side DuckDB “duckling” per session to avoid… | ||
| Integrating DuckDB with Fluvio | Sehyo Chang | 09m |
Fluvio ingests MQTT city-transit telemetry and feeds it into DuckDB via a Rust extension and CLI, demonstrating live reduction to… | ||
| Using DuckDBArrowFlight to Power a Feature Store | Till | 10m |
A feature store prototype replaces Spark jobs with DuckDB + Arrow Flight to serve parquet files from a Hoodie lake using HDFS readers and a custom connector… | ||
| lakeFS ❤️ DuckDB | Oz Katz | 05m |
lakeFS embeds DuckDB in the browser to let users preview Parquet and CSV files without downloading whole objects, using DuckDB’s footer-aware sampling so only… | ||
| nothing matches | ||