Tutorial: Debug Your Kubernetes Apps
Talkat KubeCon + CloudNativeCon North America 2019 · on Thursday, 2019-11-21· at 10:55· Room 30ABCDE - San Diego Convention Center, Upper Level·
summary
Cluster debugging focuses on exact failure modes and fixes: IP exhaustion on AWS CNI explains why 240 replicas stop at ~224; deploy CNI metrics helper to monitor pod IPs and alert, then resize subnets or instances. Fix DNS by scaling or tuning CoreDNS (memory, autoPath, node-local cache). Add metric-server for kubectl top, install cluster-autoscaler linked to ASG, use Prometheus+Grafana or CloudWatch Container Insights for alerts, and prefer CSI volumes (EBS/EFS) with StatefulSets to keep data persistent.
AI-written summary · about
chapters (71)
- 0:00Introduction
- 1:00Understanding Kubernetes
- 1:25Agenda
- 2:00Cluster Design
- 2:17Core Kubernetes Components
- 3:36How to Setup a Kubernetes Cluster
- 5:27Design Considerations
- 6:38Amazon Kubernetes Service
- 7:31QCuddle
- 7:56Master Node Components
- 9:20HDD Design
- 9:43Component Site
- 10:44Creating a Cluster
- 11:49Configuration File
- 13:50What is CI
- 14:43How CI works
- 16:16Create a deployment
- 17:37What went wrong
- 18:05Troubleshoot
- 18:51IPAMD
- 20:00Ichi
- 20:20Hello World
- 20:34IP Addresses
- 22:23CNI Metrics Helper
- 22:42Create a Policy
- 22:52Attach to EC2 Instance
- 23:09Apply YAMO
- 23:31CloudWatch
- 23:47Core DNS
- 24:39Check your DNS pods
- 25:13Add logging to DNS
- 25:51Check pod output
- 26:11Local DNS
- 26:41Memory Requirements
- 27:39AutoPath
- 28:34Cube Kernel
- 30:03Cube Cuddle
- 31:30API Server
- 33:38Common Errors
- 35:59Create New Cube Config
- 36:43Cluster Access
- 38:15I Am Role
- 39:33CubeCaudill
- 39:54Get Nodes
- 40:10Enable Public Access
- 40:59Pods
- 41:14Pod Lifecycle
- 42:35Scale Existing Deployment
- 43:17Reasons for Pending
- 44:14Describe a Pod
- 45:02Get Events
- 45:47Cubecurl
- 46:01Memory CPU Requirements
- 47:29Memory CPU Utilization
- 48:06Metric Server
- 48:27Get API Service
- 48:37CPU Usage
- 49:26Capacity Memory
- 50:31Node Capacity
- 50:55Node Allocatable
- 51:49Eject Hard and Cube Reserved
- 52:16Cluster Autoscaler
- 53:05Autoscaling Group
- 53:33Create Cluster Autoscaling
- 53:43Cluster Autoscaling logs
- 54:08Update Autoscaling group limits
- 55:07Use case
- 55:31Solution
- 56:10Load Balancer
- 58:11Load Balancer Failure
- 59:22Load Balancer Logging
related talks
50mTroubleshooting & Debugging Microservices in Kubernetes
35mKubernetes, Lessons Learnt
34mDebugging at Scale in Production - Deep into Your Containers with Kubectl Debug
50mTroubleshooting & Debugging Microservices in Kubernetes
29mWhen Kubernetes Misbehaves – Pitfalls and Lessons Learned
34mBecoming an Expert of Diagnosing a Kubernetes Control Plane Problem
36mKubernetes Confessions: Real Mistakes We’ve All Made (and What They Teach Us)
35mKlustered: Kubernetes Debugging Live
