Apache Spark with NodeJS? Yes, it's possible with EclairJS!

on YouTube ↗20m

" summary

EclairJS lets JavaScript and Node.js developers write data-processing code that runs on Apache Spark without writing Java. The talk explains using EclairJS to develop Spark jobs in JavaScript so Node.js users can leverage Spark for big-data processing.

AI-written summary · about

" chapters (9)

1. 0:00EclairJS and Spark intro
2. 2:18EclairJS library overview
3. 5:34Supported features
4. 7:47JavaScript example
5. 10:19Execution rules and pitfalls
6. 11:45Node.js deployment
7. 14:11Scala alternative
8. 15:14Live demo
9. 16:36Conclusion

" related talks

• 33mTo Spark or Not to SparkRussell Alexander Spitzer · Scale By The Bay 2019
• 01h 07mMyths about Spark, or Can an Ordinary Java Developer Use Spark?Evgeniy Borisov · Joker 2016
• 44mApache Spark on Azure - solution (...)Kamil Dworak · 4Developers Katowice 2019
• 52mSolving Analytical Problems using Apache SparkRohit Bhardwaj · Developer Summit 2020
• 14mLogging Apache Spark - How we made it easySimona Meriam · DataEngBytes 2021
• 45mHow to organize ETL with Node.js in a serverless architectureDmitriy Krystek · HolyJS 2023 Spring
• 55mUse Spark from AnywhereDenny Lee, Ginger Holt · Scala Days 2023 Seattle
• 46mSpark: One Tool for Everything?Iskander Fakhrutdinov · Saint HighLoad++ 2025