Interview

on YouTube ↗04m

" summary

Building a reusable streaming pipeline for multiple machine learning applications at Workday, aiming to apply the same pipeline across future projects and reduce duplicated effort. Code uses Scala with heavy reliance on the type system and functional programming patterns to eliminate classes of errors and stay pragmatic while enabling advanced features. Work balances productivity and exploration, leverages 15 years of Scala evolution, and prioritizes learning from experienced practitioners about what actually works in streaming architecture.

AI-written summary · about

" chapters (6)

1. 0:00Intro
2. 0:46Software Architecture
3. 1:26Functional Programming
4. 2:09Streaming pipelines
5. 2:37Scala
6. 3:19Scale By The Bay

" related talks

• 05mInterviewSergei Winitzki · Scale By the Bay 2017
• 38mScaling ScalaJulien Tournay, Filipe Regadas · Scala Love in the City 2021
• 38mReal Time ML Pipelines in Multi-Tenant EnvironmentsYan Yang, Karl Skucha · Scale By the Bay 2017
• 42mBuilding Robust Streaming Data Pipelines with Apache SparkZak Hassan · Open Source Summit North America 2017
• 04mNeville Li InterviewAlexy Khrabrov, Neville Li · Scale By the Bay 2017
• 54mData engineering & DataOps: Ask Me AnythingLars Albertsson, Ellen Friedman · Berlin Buzzwords 2021
• 43mBuild a Modern, End-to-End, Big Data Scala Reference ApplicationEdgar Orendain · Scale By the Bay 2017
• 19mBuilding Stateful Streaming PipelinesAnkit Jhalaria · Flink Forward Virtual 2020