Load Balancing in gRPC
summary
Covers gRPC client side load balancing mechanics: how the channel uses a name resolver and service config to instantiate an lb policy that creates and monitors subchannel connections, produces a nonblocking Picker per RPC, and returns one of four pick results. Explains concrete policies pick_first and round_robin, when each reduces connections or spreads load, and notes the gRPC Go load balancing API is experimental but pluggable so custom policies can be implemented.
AI-written summary · about
chapters (6)
- 0:00Introduction to load balancing
- 1:00Load balancing architectures
- 4:05Client-side policies
- 8:30gRPC client workflow
- 13:00Load balancing API in Go
- 19:15Q&A and closing
related talks
22mLoad Balancing in gRPC
35mgRPC Load Balancing on Kubernetes - Jan Tattermusch, Google
01h 01mgRPC client-side load balancing — why, what, how and WTF?
29mgRPC load balancing and Service Mesh
33mCloud Native Load Balancing From Scratch
18mDeveloping a Custom Load Balancer to serve traffic at scale
41mgRPC Deep Dive
33mCloud Native Load Balancing From Scratch