John A. De Goes Interview
summary
SlamData builds an advanced analytics compiler that translates workflows to MongoDB, MarkLogic, Couchbase, Spark or Postgres and insists on 100% correct results—no off‑by‑ones and no null pointer surprises reported in production. It runs on the JVM using Scala, faces heap churn and garbage‑collection limits, and maintains a codebase of hundreds of thousands of lines of Scala. Current engineering work focuses on packaging for Mesos/YARN, multi‑node distribution, error recovery, redundancy and load balancing.
AI-written summary · about
chapters (5)
- 0:00Intro
- 1:10Challenges with scaling
- 1:55Challenges with distribution
- 2:36Functional programming
- 4:53Networking
