Running eBay’s High-Performance Workloads with Kubernetes

on YouTube ↗32m

" summary

eBay runs multiple 2000+ node clusters and reports 160,000 pods on 24,000 hosts using a homegrown fleet manager built on Kubernetes CRDs/operators that provisions bare metal via Foreman and Kickstart, deploys OS trees with RPM-OSTree and Salt, and manages rolling OS/K8s updates. Control plane is five masters active‑active with dedicated SSDs for etcd; tuning includes max-inflight limits and client-side informer usage tested with Kubemark 10,000-pod test. Networking uses IPVS, IPVLAN, RPS/RFS and BBR; storage moves toward CSI dynamic local volumes.

AI-written summary · about

" chapters (10)

1. 0:00Intro
2. 0:57eBay's k8s deployments
3. 5:42A single AZ architecture view
4. 10:44Now we have lots of clusters built, How do they (control plane) perform?
5. 12:03Control Plane Performance
6. 17:53Building Containers
7. 21:04Pod spec
8. 23:34Host Runtime performance
9. 28:04Network performance
10. 29:18Manage the performance

" related talks

• 28mBuilding and Managing Kubernetes with KubernetesXin Ma · KubeCon + CloudNativeCon China 2019
• 28mBuilding and Managing Kubernetes with KubernetesXin Ma · KubeCon + CloudNativeCon + Open Source Summit China 2019
• 38mModel and Operate Datacenter by Kubernetes at eBayXiaogang Xin, Tommy Mei · KubeCon + CloudNativeCon China 2018
• 35meBay Geo-Distributed Database on Kubernetes [A]Xinglang Wang, Chengyuan Li · KubeCon + CloudNativeCon North America 2017
• 34meBay Search On K8sMohnish Kodnani, Yashwanth Vempati · KubeCon + CloudNativeCon North America 2019
• 36mOperator Framework to Manage Production Grade Stateful WorkloadsXin Xu, Xinglang Wang · KubeCon + CloudNativeCon China 2018
• 21mLessons from the Field: Running Kubernetes at the WellsiteMichael Maxey · Kubernetes on Edge Day NA 2023
• 17mKeynote: Extending Kubernetes: Application Orchestration to 1000’s of Clusters in...Rohan Kapadia · KubeDay India 2023