Big Data Science in Scala
summary
The talk explains how Scala libraries — Saddle, Smile and Spark MLlib — leverage Scala’s functional features, object-oriented hybrid nature and scalability to meet growing Big Data data-science needs. It describes using these tools for descriptive statistics and real-time analysis and includes a machine-learning demo predicting ad-clicks, while discussing strengths, use cases and areas for improvement.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 2:29Scala libraries
- 3:10Binary classification
- 6:50Data preprocessing
- 9:01Categorical data
- 11:33Random Forest
- 12:58Model evaluation
- 14:01Execution time
- 15:30Conclusion
- 16:18Q&A
related talks
32mWhy Use Scala in a Bigdata Context?
42mScala: The Unpredicted Lingua Franca for Data Science
01h 05mData Visualization with Scala tools
01h 03mBig Data Pipelines With Scala - Part 1 of 2
43mIntroduction to Spark Datasets
44mProcessing large data with Apache Spark
30mBig Data and Small Data Everywhere, All at Once
36mData pipelines engineering made simple with Scala