Ibis- Expressive analytics in Python at any scale
summary
Ibis is a pure Python library that builds type-checked expressions and compiles them to SQL or native backends (duckdb, sqlite, postgres, spark, clickhouse, bigquery, pandas, polars, etc.). The demo shows casting broken string columns to int/float, joining movie metadata with ratings, filtering to >100000 votes, and producing top‑10 results — all validated before execution via a deferred execution model. It supports dot SQL escapes, multiple backends, and a prototype that parses SQL into Ibis Python within months.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:05Data translation problem
- 3:54Why SQL isn't the perfect solution
- 7:03Ibis as Python alternative
- 11:11Deferred execution
- 14:40Live demo
- 26:29Ibis features recap
- 29:00Supported backends
- 32:00Q&A
related talks
01h 17mIbis: A fast, flexible, and portable tool for data analytics
02h 16mIntroduction to Ibis: blazing fast analytics with DuckDB...
28mIbis framework, Making data science work at any scale
42mIbis: Don't Let the Engine Dictate the Interface
27mBecause SQL Is Everywhere
37mSpark Backend for Ibis: Seamless Transition Between Pandas...
32mBecause SQL is everywhere but you don't want to use it
37mAccelerating Python Analytics by In-Database Processing