Load Balancing in gRPC

on YouTube ↗22m

" summary

Explains gRPC client-side load balancing with the actual LB policy API, the plug-in builder/balancer/clientConn/picker interfaces, and how service config service config names LB policy drives runtime selection; shows subchannel lifecycle and a common state-aggregation rule (ready > connecting > idle > transient failure); defines picker semantics and fast-path return types picker returns complete queue fail drop and notes the Java/Go APIs are experimental while implementations remain stable.

AI-written summary · about

" chapters (7)

1. 0:00Load balancing in gRPC
2. 1:24Server vs client-side
3. 3:10Load balancing policies
4. 6:43gRPC client load balancing
5. 10:12Subchannels and states
6. 13:01Load balancing API
7. 17:58Q&A

" related talks

• 25mLoad Balancing in gRPCEaswar Swaminathan · gRPConf 2024
• 01h 01mgRPC client-side load balancing — why, what, how and WTF?Dmitriy Bugaychenko · Joker 2021
• 33mCloud Native Load Balancing From ScratchFangyuan Li · KubeCon + CloudNativeCon + Open Source Summit China 2019
• 29mgRPC load balancing and Service MeshVishal Powar · KubeCon + CloudNativeCon Europe 2019
• 35mgRPC Load Balancing on Kubernetes - Jan Tattermusch, GoogleJan Tattermusch · KubeCon + CloudNativeCon Europe 2018
• 18mDeveloping a Custom Load Balancer to serve traffic at scaleSandeep Bhat · IndiaFOSS 3.0
• 33mCloud Native Load Balancing From ScratchFangyuan Li · KubeCon + CloudNativeCon China 2019
• 23mDemystifying Load Balancing in IstioShivanshu Raj Shrivastava, Jimmy Song · IstioCon 2023