Myths about Spark, or Can an Ordinary Java Developer Use Spark?

on YouTube ↗01h 07m

" summary

Presentation introduces Apache Spark for Java developers, explaining how Spark works, what tasks it can handle (batch, streaming, integrating with various databases) and how to use its functional programming APIs instead of scripts or SQL. The talk covers common beginner problems and solutions, Spark syntax and tips, with extensive live coding so attendees can start using Spark themselves.

AI-written summary · about

" chapters (16)

1. 0:00Spark myths introduction
2. 1:25Conceptual myths
3. 3:52Spark vs Hadoop and locality
4. 8:03Spark history and versions
5. 13:59RDD basics and API
6. 20:40RDD performance issues
7. 24:09Java vs Scala for Spark
8. 27:18Scala advantages in Spark
9. 30:51Java API demo
10. 41:27Broadcast variables
11. 47:03Spark and Spring
12. 51:59DataFrames basics
13. 57:19DataFrames from unstructured data
14. 59:03Custom functions in Spark
15. 1:01:09Pop music analysis
16. 1:05:29Conclusion and Q&A

" related talks

• 01h 12mBig Data in Java World: Apache Spark and Scala. Arch and live codingOleg Klimenko · Java ON 2022
• 01h 00mGetting Started with SparkNikhil Nanivadekar · Devnexus 2020
• 46mSpark: One Tool for Everything?Iskander Fakhrutdinov · Saint HighLoad++ 2025
• 56mThe Magic of Spark: How High-Level Pipelines Become Distributed HardcorePasha Finkelshteyn · Joker 2021
• 50mIntroduction to Real-Time Big Data with Apache SparkTaras Matyashovsky · JavaDay Lviv 2015
• 50mA Java Implementer's Guide to Better Apache Spark PerformanceTim Ellison · Jfokus 2016
• 52mSolving Analytical Problems using Apache SparkRohit Bhardwaj · Developer Summit 2020
• 53mLord of the SparkEvgeny Borisov · JavaDay Lviv 2016