Ibis: A fast, flexible, and portable tool for data analytics
summary
Ibis gives a pandas‑like API that builds deferred execution expressions and compiles them to dialect-specific SQL for backends like BigQuery Snowflake Spark and DuckDB so the same Python code runs locally or on remote engines. The demo uses parquet and DuckDB M‑tables a 479000‑row dataset sampled at 5% for development then executes the full query on Snowflake producing sensible top‑movie results — the compile‑and‑run approach works. local sampling workflow
AI-written summary · about
chapters (11)
- 0:00Ibis introduction
- 7:11Setting up Ibis
- 10:12Loading and querying data
- 21:10Metric to imperial
- 32:16Filtering penguin data
- 34:56Casting missing data
- 37:49In-memory tables
- 44:54Joining tables
- 53:09Column references and expressions
- 1:01:44IMDb analysis
- 1:13:27Backend execution
related talks
02h 16mIntroduction to Ibis: blazing fast analytics with DuckDB...
28mIbis framework, Making data science work at any scale
44mIbis- Expressive analytics in Python at any scale
42mIbis: Don't Let the Engine Dictate the Interface
37mSpark Backend for Ibis: Seamless Transition Between Pandas...
27mBecause SQL Is Everywhere
28mAnalyze data easily with duckdb - and the implications on data architectures
39mPython and SQL: Better Together, Powered by DuckDB