Interview

on YouTube ↗06m

" summary

Maintains the Spark Cassandra connector, a production connector used to run Spark on Cassandra data, and describes new work that uses the Catalyst optimization engine to perform automatic join/function pushdown so users no longer write manual optimizations; reports these changes make common queries faster by letting Spark rewrite specific function calls and joins into pushdowns. Emphasizes a focus on end-user ergonomics, worries about mismatched Scala versions across deployments, and mentions teaching JavaScript developers to prefer map/filter/reduce over mutable loops.

AI-written summary · about

" chapters (4)

1. 0:00Start
2. 0:21What are you building and what's the coolest thing about it?
3. 1:42What kind of best practices are you going to share?
4. 2:21What kind of best practices are you hoping to learn?

" related talks

• 05mInterviewRussell Alexander Spitzer · Scale By The Bay 2019
• 33mTo Spark or Not to SparkRussell Alexander Spitzer · Scale By The Bay 2019
• 54mHarnessing the Power of Spark & Cassandra within your Spring AppSteve Pember · Spring I/O 2017
• 04minterviewUmayah Abdennabi · Scale By The Bay 2019
• 21mAvoiding Spark Pitfalls at ScaleLong Cao · Scale By the Bay 2017
• 40mSpark Analytics on Cassandra DataTim Berglund · Jfokus 2016
• 43mOptimizing Spark applications from simple to complex with examplesAleksandr Markachev · HighLoad++ 2024
• 04mKuassi Mensah InterviewAlexy Khrabrov, Kuassi Mensah · Scale By the Bay 2017