Apache Flink in Production with Ververica Platform
summary
Ververica Platform releases a free Community Edition that runs on Kubernetes 1.11+ with any S3/HDFS-compatible object store and exposes a REST API plus YAML for CI/CD. It raises Flink from applications not jobs so code, state and config travel together, supports stateful upgrades, cancel+retain checkpoints and forks for fork for bluegreen testing. Demo processes GitHub commits (job shows 105 checkpoints), uses Prometheus metrics and ships OpenSSL with ~OpenSSL 200% performance gain versus Java SSL.
AI-written summary · about
chapters (24)
- 0:00Introduction
- 0:37Challenges in Flink
- 2:59Platform Overview
- 6:52Deployment and UI Demo
- 14:02State Snapshot Management
- 14:18Monitoring and Metrics
- 15:04Metrics and Logs Scoping
- 15:56Q&A: Architecture
- 16:42Cluster Scaling
- 17:56Operational Changes
- 18:07Stateful Upgrades
- 19:37Post-Upgrade Review
- 20:07Advanced Configuration
- 20:38Security Features
- 20:48Resource Allocation
- 20:58Deployment Defaults
- 27:10Failure Recovery
- 27:21Rollback Procedures
- 28:13REST API and Automation
- 31:40Support Licensing
- 32:20Enterprise Features
- 32:46Engineering Support
- 33:00Deployment Forking
- 33:14Bluegreen Deployment
related talks
16mFrom Zero to Production with Ververica Platform
26mKubernetes & real-time analytics: How to connect these worlds with Apache Flink
22mBuilding a Kubernetes Operator for Apache Flink in Java
20mFlink powers Houzz near-realtime pipeline & Kubernetes logging observability
17mGetting Started with Flink for Small Teams w/ RabbitMQ and Kubernetes
42mStream Processing with Apache Flink
58mReal-Time ML Applications at Scale with Flink and Beam on Kubernetes and GCP
44mLets Deeploy Flink - Uncovering Hidden Depths of Yarn, Docker, Kubernetes & Beyond