Metrics Stream Processing Using Riemann

on YouTube ↗24m

" summary

Riemann is an event stream processor written in Clojure that treats each metric as a map with a TTL per event so expiry drives down-detection; it keeps a log-free in-memory index, exposes Clojure-configured streams (functions) for filtering, splitting, merging and composing, and lets you build reusable libraries and unit/integration tests for configs. Integrations include Netty/protobuf, mTLS, Kafka, TSDBs; features for alerts include rollup and throttle and a tap breakpoint; gotchas are clock skew, config-reload state loss, no built-in sharding.

AI-written summary · about

" chapters (7)

1. 0:00Start
2. 1:11INTRODUCTION
3. 2:46RIEMANN CORE CONCEPTS
4. 13:21RIEMANN CONFIGURATION: TESTING
5. 15:21DETECT SERVICE GOING DOWN
6. 18:58THINGS BREAKING: ROLLUP & THROTTLE
7. 20:58SCALING RIEMANN

" related talks

• 30mBuilding a Large-Scale, Streaming-Based Logging and Monitoring SolutionMarcus Crestani · code.talks 2022
• 43mGenerating and Analyzing EventsZach Tellman · EuroClojure 2012
• 18mJon Schneider at SpringOne Platform 2017Jon Schneider · SpringOne Platform 2017
• 21mSweet Streams are Made of These: Applying Metrics-driven Development to Apache FlinkCaito Scherr · Flink Forward Global Virtual 2020
• 41mRuby Monitoring State of the UnionJoseph Ruscio · RubyConf 2012
• 14mMetrics Without LimitsMichael Gerstenhaber · Dash 2019
• 35mThe Internals of Metric StoreTodd Persen · Cloud Foundry Summit Europe 2019
• 27mGrand Treatise of Modern Instrumentation and OrchestrationBjörn Rabenstein · Golang UK 2016