From Big Data to Fast Data: Apache Spark

on YouTube ↗45m

" summary

Overview of Apache Spark as an alternative to MapReduce for cluster computing, focusing on moving from batch-oriented Big Data (Hadoop) to real-time stream processing (Fast Data). Covers Spark and its ecosystem and includes a few short examples showing how Spark handles continuous data streams and distributed processing.

AI-written summary · about

" chapters (12)

1. 0:00Introduction
2. 2:13Big Data vs Fast Data
3. 4:48MapReduce limitations
4. 6:11Apache Spark features
5. 9:46Spark architecture
6. 13:58Resilient Distributed Dataset
7. 17:47Word Count example
8. 21:42Computation graph
9. 26:00Spark ecosystem
10. 28:28Spark Streaming
11. 34:12Summary
12. 38:26Q&A

" related talks

• 11mHow Companies are Using Spark, and Where the Edge in Big Data Will BeMatei Zaharia · Strata Conference 2014
• 44mData Science at Scale with Apache SparkDean Wampler · GOTO Chicago 2015
• 50mIntroduction to Real-Time Big Data with Apache SparkTaras Matyashovsky · JavaDay Lviv 2015
• 52mSolving Analytical Problems using Apache SparkRohit Bhardwaj · Developer Summit 2020
• 29mBig Data AnalysisSerhiy Masyutin · JavaDay Lviv 2015
• 46mSpark: One Tool for Everything?Iskander Fakhrutdinov · Saint HighLoad++ 2025
• 01h 12mBig Data in Java World: Apache Spark and Scala. Arch and live codingOleg Klimenko · Java ON 2022
• 17mMachine Learning at the Speed of Light with SparkLudwine Probst · Scala.IO 2014