Scaling Web Operations with Distributed Cluster Schedulers

on YouTube ↗01h 03m

" summary

Covers how to scale web operations using distributed cluster schedulers, focusing on Nomad (HashiCorp) and related technologies for scheduling heterogeneous virtualized workloads. Discusses approaches used in large-scale systems and public-cloud environments, drawing on experience building cluster schedulers and container orchestration (Apache Mesos, Docker on AWS) and service discovery for high-throughput, highly available platforms.

AI-written summary · about

" related talks

• 40mNomad: Scheduling Applications at ScaleSeth Vargo · GOTO Stockholm 2016
• 34mPatterns for building Highly Available Cluster SchedulersDiptanu Gon Choudhury · ScaleConf Colombia 2018
• 33mDistributed Scheduler HellMatthew Campbell · SREcon17 Asia/Australia
• 27mKeynote Panel: Future of Cluster ManagementElizabeth K. Joseph · MesosCon North America 2017
• 31mOrchestration with NomadChristoph Kappel · code.talks 2023
• 29mScaling Data Workloads with Cluster ManagersAlessandra Bilardi · containerday 2025
• 34mEmbracing Upstream Kubernetes in Web Scale OrganizationLei Zhang, Jun Chen · KubeCon + CloudNativeCon Europe 2019
• 25mAutoscaling Your Nomad Jobs Using SRE InsightsBram Vogelaar · HashiTalks 2021