Introduction to Spring for Apache Hadoop

on YouTube ↗01h 21m

" summary

Hands-on walkthrough of Spring Data Hadoop showing Groovy Grab + Spring Boot to wire an FS shell, run a compiled MapReduce jar (JSON tweet mapper + reducer) against a Hadoop 2.4.1 mini‑cluster VM and get real results — hashtag counts (example: "hadoop" = 18) — and a Hive JDBC query returning a top‑10 (example: IBM Analytics ≈ 20,000 followers). Covers packaging for Spring XD (assembly plugin to deploy job modules), Spring Batch orchestration, and successful end‑to‑end demos.

AI-written summary · about

" chapters (15)

1. 0:00Introduction to Spring Hadoop
2. 2:14Hadoop Challenges and Solutions
3. 5:16Groovy Example: Hello World
4. 9:13Java Configuration for Hadoop
5. 13:10Spring Hadoop Key Features
6. 18:12Version Management and Flavors
7. 22:26Developing a MapReduce Job
8. 29:01Running the MapReduce Demo
9. 34:03Hive Integration with JDBC
10. 37:21Orchestrating Workflow Steps
11. 43:53Spring XD Integration
12. 50:58Robust Batch Workflows
13. 55:50Data Export and Final Output
14. 1:08:34Future Plans and Resources
15. 1:12:46Yarn Demo and Q&A

" related talks

• 01h 14mHow to build Big Data Pipelines for Hadoop using OSSCostin Leau · SpringOne2GX 2012
• 01h 27mAn Introduction to Spring DataMichael Hunger, Mark Pollack, Jon Brisbin · SpringOne2GX 2012
• 30mDelivering the Power of Data Using Spring Cloud Data Flow - Gilbert Lau, Wayne LundGilbert Lau, Wayne Lund · SpringOne Platform 2017
• 54mHarnessing the Power of Spark & Cassandra within your Spring AppSteve Pember · Spring I/O 2017
• 53mLord of the SparkEvgeny Borisov · JavaDay Lviv 2016
• 01h 12mBig Data in Java World: Apache Spark and Scala. Arch and live codingOleg Klimenko · Java ON 2022
• 01h 20mSupercharging Operations and Analytics: Using Spring XD to Support Analytics and CEPJoseph Paulchell · SpringOne2GX 2015
• 52mSolving Analytical Problems using Apache SparkRohit Bhardwaj · Developer Summit 2020