~/talk

From raw data to interactive data app in an hour

Talkat PyData Global 2023 · 2023-12-06..12-08· [data-engineering, machine-learning]
slides:none on file

Claims an end-to-end data pipeline and interactive app from raw CSV to deployed model inside Snowflake using Snowpark ML modeling API and model registry. Workflow ingests a 54,000‑row diamonds CSV, does cleaning, ordinal and one‑hot encoding, min‑max scaling, trains an XGBoost regressor, runs grid search, improves MAPE from 0.07 to 0.06, logs the model, deploys for inference, and uses zero‑copy cloning and container services for GPU where needed. The demo runs and deploys successfully.

AI-written summary · about

  1. 0:00Introduction
  2. 5:19ML and pipeline challenges
  3. 9:11Snowflake vs data silos
  4. 13:27Unified Python workflows
  5. 17:46Snowpark ML optimizations
  6. 20:56ML modeling APIs
  7. 21:16MLOps model registry
  8. 24:26Setting up prerequisites and Snowflake trial
  9. 30:28Lab environment setup
  10. 35:11Data ingestion with Snowpark
  11. 46:17Feature engineering
  12. 58:26Training XGBoost
  13. 1:05:06Hyperparameter tuning
  14. 1:09:08Deploying models
  15. 1:14:03End-to-end summary
  16. 1:15:40Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.