Get your Data prod ready, Fast, with Ruby Polars!
summary
Uses the Ruby Polars gem (Rust core, Ruby API) to clean a CSV-sized dataset — the demo shows handling ~500,000 rows × 100 columns with missing and mixed types, wrong names and an outlier (Waterworld) removed via filter. Shows exact APIs used: with_columns, get_columns, fill_null (with pol.lit), custom NaN counting via isnan, string→to_datetime with format and nanoseconds, vstack to combine frames, unique to drop duplicates, then to_rows(named: true) and ActiveRecord insert_all to bulk import.
AI-written summary · about
chapters (19)
- 0:00Welcome
- 1:04Ruby for data and AI
- 3:33Ruby Polars library
- 7:48Data types in Polars
- 8:31API data import
- 11:44Removing outliers
- 13:08Restructuring data
- 14:13Missing values handling
- 18:47New columns formatting
- 20:35CSV import and cleaning
- 22:47Combining data sources
- 23:51Removing duplicates
- 24:55Exporting to database
- 26:39Advanced Polars techniques
- 26:59Extract month from datetime
- 29:27Composite movie scores
- 30:52Data visualization with Vega
- 31:55Growing Ruby data ecosystem
- 32:15Resources and closing
related talks
21mPolars: A highly optimized dataframe library
02h 14mGetting Started with Polars
01h 32mAn Introduction to Polars
22mDon’t Write Polars Code with a Pandas Accent
34mBuilding Data Driven Products with Ruby
39mKnow Your Data(Frame) with Paguro
31mPolars, the End of Spark?
01h 31mPandas, Data Wrangling & Data Science