Case Study of Batch Processing With Spring Cloud Data Flow Server in Cloud Foundry

on YouTube ↗32m

" summary

Replatformed RiskMeter implements batch runs as Cloud Foundry tasks orchestrated by Spring Cloud Data Flow Server using Spring Cloud Task + Spring Batch, with artifacts registered in Maven and inputs stored on EMC ECS (S3 API). Blue/green deployments run web and task smoke tests in parallel, then reroute traffic; completed CF task records are trimmed. Real-time progress uses RabbitMQ + WebSockets to an Angular front end. Team delivers the feature in about two months.

AI-written summary · about

" chapters (12)

1. 0:00Introduction and agenda
2. 3:22Batch processing need and design
3. 6:15Technology stack selection
4. 9:43Decomposing monolithic backend
5. 12:15Implementing batch feature
6. 18:37Lessons learned overview
7. 20:28Deployment pipeline changes
8. 24:19Data passing between systems
9. 26:51Configuration management
10. 28:39Demo introduction
11. 29:03Live demo of batch processing
12. 31:09Conclusion and Q&A

" related talks

• 01h 29mBatch Processing and Integration on Cloud FoundryJosh Long · SpringOne2GX 2012
• 50mWalking Through Spring Cloud Data FlowGlenn Renfro, Ilayaperumal Gopinathan · SpringOne 2020
• 30mBanking on Cloud Foundry Platform: A Case Study of Digital Business Banking ApplicationsSurya V Duggirala, Milorad Stefanovic · Cloud Foundry Summit Europe 2017
• 01h 31mRunning Your Spring Apps in the CloudCornelia Davis · SpringOne2GX 2014
• 44mData Processing With MicroservicesMichael Minella · Spring I/O 2017
• 32mBuilding Data-Driven IoT Apps on Cloud Foundry - Dormain Drewitz, PivotalDormain Drewitz · Cloud Foundry Summit Europe 2017
• 01h 32mCloud Native Data Flow OrchestrationMark Fisher, Patrick Peralta · SpringOne2GX 2015
• 48mKubernetes and or Cloud Foundry - State-of-the-art cloud platformsMatthias Haeussler · Spring I/O 2019