Virtual Book Signing – Jean-Georges Perrin
summary
Book claims cover Apache Spark up to Spark 3 released June, with a 600‑page Manning volume and an open GitHub repo containing Java examples in repo. Examples run locally — Spark runs on a laptop — and is used at Advance Auto Parts for both ETL and data science, hooked into Databricks/Watson Studio and Kafka. Specifics include in‑memory compression saving roughly 20% of RAM and practical, tested code that boots and works.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 1:07Why I wrote Apache Spark book
- 4:18Data engineering to Spark journey
- 7:13Q&A on Spark and Hadoop
- 9:43Spark more accessible than Hadoop
- 11:28Challenges learning Spark
- 18:19Book helps Java devs learn Spark
- 21:10Spark adoption trends
- 25:24Unexpected Spark use cases
- 27:32Spark as data OS
- 31:50Surprising Spark users
- 35:09Later sessions today
- 38:22Working with Manning
- 42:55Editing value
- 43:16Final Q&A
related talks
06mOpen by design, open for data
03mInterview
16mKeynote: Accelerating AI/ML Development with Open Source Software
06mDriving enterprise open source adoption, from data lake to AI
41mOpen Source Social Applications with Apache Streams
05mIntel and the Role of Open Source
12mKeynote: Apache CouchDB: A Tale of Community, Cooperation and Code
42mKeynote: Does Open Data Science Lead to the End of the World?