Sweet Streams Are Made Of These
summary
Builds streaming apps with Apache Flink (and mentions Beam and Kafka) and uses concrete metrics to change development: tracks watermarks monitored and per-source throughput, measures checkpoint size to catch a once‑daily drop, and separates per-stream lag so upstream teams’ different aggregation patterns surface. That led to reassigning integration ownership and routing small modular alerts to team Slack channels; the lightweight, provider‑agnostic approach scales and reduces false pages while keeping iteration fast.
AI-written summary · about
chapters (5)
- 0:00Intro
- 1:36Metrics
- 10:03How To Measure
- 13:42Keep Your Metrics Meaningful
- 20:24Metrics As A Shared Language
related talks
49mscale.bythebay.io: Stephan Ewen, Apache Flink and the Next Wave of Stream Processing Applications
19mBuilding Stateful Streaming Pipelines
50mStream Processing Smackdown: Kafka Streams vs. Apache Flink
50mApplication development and data in the emerging world ...
38mApache Flink: A Very Quick Guide
44mData Streaming: Which horse to bet on?
39mEvaluating Streaming Framework Performance for a Large-Scale...
34mBeaming Flink to the Cloud @ Netflix
