Integrating DuckDB with Fluvio
summary
Fluvio ingests MQTT city-transit telemetry and feeds it into DuckDB via a Rust extension and CLI, demonstrating live reduction to latitude/longitude/vehicle_speed and mapping the stream into SQL tables for ad hoc queries. WebAssembly transforms run inside the Fluvio cluster to filter and reshape events near the source, the demo shows about 60,000 events streaming in, uses a Rust extension and WebAssembly transforms, and copies a table to test query performance — the pipeline runs live and supports GROUP BY speed and other SQL analytics.
AI-written summary · about
related talks
40mDuckDB: Harnessing in-process analytics for data science and beyond
40mDuckDB beyond the notebook
34mData Wrangling with DuckDB
33mData preparation and analytics on your laptop with DuckDB
45mUnderstanding geospatial data with duckdb
05mBuilding local-first analytics apps with SQLRooms
25mA quack of all trades: DuckDB, a versatile analytical database to keep in your toolkit
01h 02mAnalytics for not-so-big data with DuckDB