Orchestrating Data Microservices with Spring Cloud Data Flow - Mark Pollack
summary
Spring Cloud Data Flow 1.3 orchestrates streams and batch tasks across Cloud Foundry, Kubernetes and YARN using a textual DSL, a Java DSL and a drag‑and‑drop Designer UI; demos show a Twitter sentiment with TensorFlow processor feeding a Redis field‑value counter and live visualization, and a file ingest flow where an SFTP lister launches Spring Cloud Task batch jobs that load CSVs into a DB. Lifecycle management uses Skipper to update a single app in a stream, perform blue‑green swaps and rollback versions, and a Spring Cloud Data Flow function runner lets tiny Java functions run as processors.
AI-written summary · about
chapters (9)
- 0:00Introduction to Spring Cloud Data Flow
- 10:57Tour of the Data Flow UI
- 21:52Twitter Sentiment Analysis Demo
- 33:24File Ingest Batch Example
- 38:25Stream Updates with Skipper
- 41:15Skipper Deployment Demo
- 51:07Function-Based Processing
- 53:36Project Roadmap Overview
- 56:29Q&A Session
related talks
44mData Processing With Microservices
50mWalking Through Spring Cloud Data Flow
52mCloud-native streaming and event-driven microservices
01h 17mMessage Driven Microservices in the Cloud
49mDDD Strategic Design with Spring Boot
47mData Microservices with Spring Cloud
47mFlowable business processing from Kafka events
37mJava Microservices at Scale on Cloud Foundry, Today and Tomorrow