An Open Source Distributed Rate-limiting Service for Ceph-object and Other HTTP APIs
summary
A compact open-source system that enforces cluster-wide request and bandwidth limits for S3 and other HTTP APIs, built around HAProxy + Lua hooks that emit per-request usage to a small aggregation layer which enforces limits from a reloadable JSON config. Starts as a 700-line prototype and grows to support concurrency caps, per-operation costs (e.g., expensive list or multi-delete ops), dynamic bandwidth control and mapping short-lived STS keys to stable user IDs so rate limits remain accurate.
AI-written summary · about
chapters (8)
- 0:00Introduction and motivation
- 2:29Building the initial rate limiter
- 4:37Deployment and early challenges
- 6:23Handling request concurrency
- 7:26Differentiating request types
- 8:51Supporting short-lived credentials
- 10:15Open sourcing WhereQoS
- 10:58Q&A session
related talks
34mOver a Billion Requests Served per Day: Ensuring Everyone Is Happy with Our Ceph Clusters’...
41mHigh Volume Ratelimiting with Redis
26mTraffic Management w. Rate Limiting to Ensure API Scalability & Resiliency
50mRate Limiting in Node js applications
25mArt and Science of Rate Limits for APIs
39mCeph in Scientific Computing and Large Clusters BoF
06mHow Not to DDOS Servers
15mScalable load balancing and security on AWS with HAProxy Fusion