Data Processing With Microservices

on YouTube ↗44m

" summary

Shows how to build data microservices with Spring Cloud Stream, Spring Cloud Task and Spring Cloud DataFlow and includes runnable demos and a GitHub repo. Demonstrates a time source → processor → sink flow where scaling the source from 1 to 2 JVMs doubles messages per second and a transformer replaces payloads with "it's 5 o'clock somewhere". Runs a task that records start/end/exit message (stack trace) in the task repository. Uses DataFlow to register apps, deploy a live Twitter→counter stream and visualize hashtag counts in the UI.

AI-written summary · about

" chapters (10)

1. 0:00Start
2. 9:13SPRING
3. 11:42DATA INGESTION
4. 19:04TASK REPOSITORY
5. 20:32STREAM INTEGRATION
6. 21:17BATCH JOBS
7. 21:27ONE OFF PROCESSES
8. 21:59ETL PROCESSES
9. 43:042 PARTITIONED STREAMS
10. 43:53QUESTIONS?

" related talks

• 01h 06mOrchestrating Data Microservices with Spring Cloud Data Flow - Mark PollackMark Pollack · SpringOne Platform 2017
• 52mCloud-native streaming and event-driven microservicesMarius Bogoevici · Spring I/O 2016
• 30mDelivering the Power of Data Using Spring Cloud Data Flow - Gilbert Lau, Wayne LundGilbert Lau, Wayne Lund · SpringOne Platform 2017
• 50mWalking Through Spring Cloud Data FlowGlenn Renfro, Ilayaperumal Gopinathan · SpringOne 2020
• 47mData Microservices with Spring CloudOrkhan Gasimov · JavaDay Ukraine 2017
• 58mGame of StreamsMark Heckler · Devnexus 2020
• 01h 32mCloud Native Data Flow OrchestrationMark Fisher, Patrick Peralta · SpringOne2GX 2015
• 01h 11mBootiful Stream Processing!Viktor Gamov · Java Z-Day 2021