Apache Hop

on YouTube ↗42m

" summary

Apache Hop is a metadata-driven orchestration platform rewritten from a 20-year codebase into a modular, lightweight system that boots in JVM startup time and can be trimmed below 30 MB. Claims: 129+ bug fixes on the 0.99 release and voting on 1.0; engineering: automated license headers, removal of GPL-tainted code, and single-sourced web/gui. Integrations: runs on Spark/Flink/Dataflow via Apache Beam and exposes projects via VFS. Testing: hundreds of nightly integration pipelines prove backward compatibility.

AI-written summary · about

" chapters (20)

1. 0:00Intro
2. 0:33Agenda
3. 1:13What is Apache Hop
4. 2:18How did Hop come about
5. 3:40Where to find Hop
6. 4:18Why Apache Hop
7. 5:04Requirements
8. 6:09Architecture
9. 7:59New GUI
10. 8:45GUI Configuration
11. 12:15Data Orchestration
12. 15:57Unit Tests
13. 17:29Dataflow
14. 19:27Documentation
15. 20:31Incubator
16. 22:42Copyright headers
17. 25:10Existing code
18. 31:22Integration tools
19. 35:49Roadmap
20. 38:14Questions

" related talks

• 21mApache Beam (incubating)Eugene Kirpichov · Data By the Bay 2016
• 39mHops in the CloudJim Dowling · Berlin Buzzwords 2019
• 45mMulti-tenant Flink-as-a-Service on YARNJim Dowling · Flink Forward Berlin 2016
• 17mWhat's new with Hoppscotch?Andrew Bastin · IndiaFOSS 3.0
• 41mApache Beam: Unified Data ProcessingAlexey Diomin · Voxxed Days Minsk 2018
• 47mApache Beam - what do I gain?Łukasz Gajowy · GeeCON 2019
• 33mContainerizing & Orchestrating Hadoop Infrastructure at ScaleMithun (Matt) Mathew · ContainerCon @ Open Source Summit Europe 2022
• 18mAmerica First Credit Union optimizes their MLOps stack with HopsworksRichard Woolston · Feature Store Summit 2022