Long Cao Interview
summary
Builds scalable data pipelines in Scala and Spark to consume alternative data for market signals, describes production failures that only appear at large scale and the difficulty of testing them, and contrasts throwing more machines with work that improves algorithms and memory representations. Explains shipping reliability issues for downstream consumers, the stack used at Coatue Management, and why operationalizing data engineering at scale demands both vertical optimization and end-to-end engineering rigor.
AI-written summary · about
