Running Envoy as an Edge Proxy

on YouTube ↗33m

" summary

Runs Envoy at eBay PoPs as the L7 data plane with IPVS L4 and a yuppie control plane, migrating hardware LB configs via automation and a response‑comparison validator; deploys Envoy in Kubernetes with Helm, CRDs and a discovery sidecar; uses Prometheus and ELK for metrics and logs. Implements dynamic caching backed by ATS, adds connection prefetching and BBR TCP tuning, drops kube connection count to zero and serves 50%+ traffic through edge, achieving about a tenfold TTFB improvement.

AI-written summary · about

" chapters (7)

1. 0:00Introduction
2. 2:31Edge Proxy Architecture
3. 13:53Data Plane Path
4. 18:52TCP Optimizations
5. 19:44Dynamic Caching
6. 22:39Monitoring
7. 26:02Learnings

" related talks

• 20mBuilding an Edge Control Plane with Kubernetes and EnvoyFlynn · KubeCon + CloudNativeCon Europe 2019
• 33mGet to know Envoy - the modern proxy for cloud-native infrastructure - Baptiste CollardBaptiste Collard · ContainerDays 2023
• 33mIntro: EnvoyLizan Zhou · KubeCon + CloudNativeCon + Open Source Summit China 2019
• 33mIntro: EnvoyLizan Zhou · KubeCon + CloudNativeCon China 2019
• 34mIntro: EnvoyLizan Zhou · KubeCon + CloudNativeCon Europe 2019
• 27mEnvoy Proxy: Evolved for Serving LLMsVaibhav Katkade, Andres Guedez · EnvoyCon 2025 Europe
• 27mEnvoy Gateway: An in-Depth Guide of Its Benefits, Use Ca...Ekansh Gupta, Shivanshu Raj Shrivastava · EnvoyCon 2023
• 33mTake Envoy Beyond a K8s Service Mesh - to Legacy Bare Metal & VMs + MoreSteven Wong, Steve Sloka · KubeCon + CloudNativeCon North America 2019