R Scripts to Databricks: Lessons in Production Workflow
summary
A one‑laptop R script that runs an MLB monthly conversion metric becomes a production pipeline that automates and scales measurement of ESPN live TV ad effects into cross‑channel conversions such as Disney+ bundle subscriptions and website engagement. The team refactors a counterfactual model borrowed from a Hulu project, adds Python and SQL, uses Databricks Workflows to orchestrate jobs, and publishes results to a Tableau dashboard. Migration and refactoring take about two to three months and successfully replaces the manual process.
AI-written summary · about
related talks
40mProductionizing Big Data - Stories from the Trenches
11mScaling R with Spark
18mDatabricks drives predictive maintenance, grid optimization with analytics
19mFrom SDKs to Agents: Building with R and Python on Databricks
11mHow Data Intelligence is Delivering Big Wins at Texas Rangers
30mData Engineering building your BI infrastructure from scratch
01mDatabricks Customers
39mData Pipeline Evolution