Protector - a circuit breaker for InfluxDB
summary
trivago ingests about 4 Mbit/s into InfluxDB and runs hundreds of thousands of queries per day, and ~0.7% of queries turn out to be harmful (roughly 4,000 potential incidents per month). Protector is a circuit breaker that inspects InfluxQL, blocks malicious queries (large SELECTs, GROUP BY resolutions that explode, DROP/DELETEs), enforces rules and limits, runs in Docker (prototype available in Python), drastically reduces query-caused overloads, and is being released as open source.
AI-written summary · about
chapters (11)
- 0:00Intro
- 0:53What is a circuit breaker
- 3:18Why InfluxDB
- 8:41How it works
- 13:47Query examples
- 14:17Grouping aggregation
- 19:07Circuit breakers
- 22:17Protector goals
- 24:37Protector rules
- 28:07Preventing outages
- 31:49Demo
related talks
26mIntegrating Prometheus and InfluxDB
47mSpeeding Up InfluxDB Queries with InfluxQL Continuous Queries and Data Partitioning
12mInfluxDB for Industrial IoT
28mTime series data science problems with InfluxDB
22mExploring the InfluxDB Ecosystem Integrations, Libraries, and Plugins
13mNext-generation databases for next-generation workloads (PRT051)
32mManaging Databases in the Cloud in Broken
16mEnable better performance and reduce storage cost with InfluxDB 3.0