lakeFS ❤️ DuckDB

on YouTube ↗05m

" summary

lakeFS embeds DuckDB in the browser to let users preview Parquet and CSV files without downloading whole objects, using DuckDB’s footer-aware sampling so only necessary byte ranges are fetched. An HTTPFS adapter plus a implemented head-object equivalent exposes those ranges from lakeFS S3-compatible APIs, and a small macro enables query across branches and tags. The feature is integrated into the latest UI, runs locally in the browser, and successfully demos fast, low-bandwidth exploration.

AI-written summary · about

" chapters (4)

1. 0:00Introduction
2. 0:36What is LakeFS?
3. 2:13Why integrate DuckDB?
4. 3:38Technical implementation

" related talks

• 40mDuckDB Meets Data LakesGabor Szarnyas · Øredev 2025
• 28mAnalyze data easily with duckdb - and the implications on data architecturesMatthias Niehoff · PyCon DE & PyData 2025
• 40mDuckDB beyond the notebookMatthias Niehoff · Berlin Buzzwords 2026
• 26mBuilding Data Lake Using DuckDBSubash Roul · DuckCon #4
• 47mWhy DuckDB could be the engine for your Data Lake?Vincent Heuschling · Voxxed Days Luxembourg 2023
• 47mGábor Szárnyas | Data Track | Compass AI & Data Summit 2025Gabor Szarnyas · Compass AI & Data Summit 2025
• 01h 02mAnalytics for not-so-big data with DuckDBDavid Ostrovsky · NDC Oslo 2025
• 27mSwiftLake: Bringing Apache Iceberg and DuckDB Together for a Smarter Data ManagementVarunkumar · Great International Developer Summit 2025