Juliet Hougland, Data Scientist, Cloudera
summary
Compares three open-source distributed eigen/SVD implementations—Mahout’s LanczosSolver, Mahout’s StochasticSVD, and Spark MLLib’s SVD—for large matrices that don’t fit in a single machine’s memory. Covers real-world tradeoffs in accuracy and performance (beyond algorithmic FLOPs) and gives guidelines for selecting an implementation based on accuracy, performance, and scale requirements.
AI-written summary · about
chapters (4)
related talks
16mAndrew Musselman, Committer & PMC Member, Apache Mahout at MLconf Seattle 2017
31mFrom Pandas to Spark
21mMaja Kabiljo, Software Engineer, Facebook Inc.
31mA practical guide to Singular Value Decomposition in Python
17mMachine Learning at the Speed of Light with Spark
51mApache Spark and machine learning: dreams and realities
19mEfficient Decentralized Federated Singular Vector Decomposition
44mData Science at Scale with Apache Spark
