Solving the Scala Notebook Experience
summary
PolyNote is a polyglot, server-backed notebook that goes from POC to usable MVP in under ten months and dozens of users. It runs Scala, Python and Spark SQL cells, shares state only downward so notebooks re-run top-to-bottom reproducibly, shows live autocomplete, squiggly compiler errors and execution progress, and embeds a Monaco editor. Dependencies load via Coursier, Python via JEP, config and notebooks use Circe, async runtime uses ZIO/Cats-effect, and the open-source tool demonstrably works for real Netflix workflows.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 0:18PolyNotes
- 0:52Why PolyNotes
- 4:43What We Learned
- 7:13Why Scala
- 10:47Notebook Reproducibility
- 14:25Visibility
- 17:50Polyglot
- 20:16Configuration Management
- 22:28Data Visualization
- 24:55Building It
related talks
47mScala: The Unpredicted Lingua Franca for Data Science
37mReproducible and shareable notebooks across a data science team
25mTo Notebook or Not to Notebook: Multilingual Workflows for Data Analysis
50mBeyond Interactive: Empowering Everyone with Jupyter Notebooks
32mData Science in Scala with ScalaPy
31mNotebooks that dream with marimo
31mBringing the Jewels of the Python World to Scala with Spark
45mData Science Apps: Beyond Notebooks