Kotlin for Apache Spark

on YouTube ↗01m

" summary

Introduces a new Kotlin API called continuity for Apache Spark that reimplements core Spark primitives, shows concrete code translating DataFrame/SQL and RDD patterns into idiomatic Kotlin, demonstrates interoperability with existing Java/Scala Spark code, and runs a small end-to-end ETL example built with Maven/Gradle to prove the API executes on Spark and is usable in real jobs.

AI-written summary · about

" related talks

• 47mScala: The Unpredicted Lingua Franca for Data ScienceDean Wampler, Andy Petrella · Scala Days Berlin 2016
• 35mExploratory Data Analysis with Spark and IntelliJ IDEAMaria Khalusova · Data Con LA 2019
• 33mTo Spark or Not to SparkRussell Alexander Spitzer · Scale By The Bay 2019
• 47mThe future of data: Apache Spark 3.1, Delta Lake and KoalasSeifeddine Saafi, Quentin Ambard · Devoxx France 2021
• 01h 12mBig Data in Java World: Apache Spark and Scala. Arch and live codingOleg Klimenko · Java ON 2022
• 51mDataFrame: Kotlin's Innovative Approach to Data StructuresRoman Belov · Devoxx Belgium 2024
• 43mKotlin 4 vs. Scala 3Garth Gilmour, Eamonn Boyle · GOTO Oslo 2020
• 46mScala and the JVM as a Big Data PlatformDean Wampler · Scala World 2015