Testing Kubernetes Clusters - Building Confidence in Your Changes
Talkat KubeCon + CloudNativeCon North America 2021 · on Thursday, 2021-10-14· at 16:30· Petree Hall C + Online·
summary
Skyscanner builds a Sonobuoy plugin that runs targeted Kubernetes e2e tests (reusing upstream e2e code) and wires test exit codes into Spinnaker CD, giving per-change gating instead of the slow full conformance run. It runs against 35 production clusters (about 40,000 CPU cores and 475 services), uses a custom e2e image and mirrored registries, and blocks rollouts on failures. Drawbacks: vendoring upstream test code and run.sh tweaks for versions, and flaky results on highly dynamic (spot) nodes.
AI-written summary · about
chapters (16)
- 0:00Intro
- 0:46Guy Templeton
- 1:17Matteo Ruina
- 4:12Why testing
- 5:27Manual Acceptance Testing
- 6:37Custom Service
- 8:39kubetest
- 9:50The Conformance Suite
- 10:57Sonobuoy
- 11:36Requirements
- 13:34Solution
- 14:56Our setup
- 19:41Example
- 21:30Gotchas with our approach
- 26:18Tips
- 27:46Other Projects
related talks
36mEfficient Kubernetes E2E Testing: Unleash the Power of Prow
35mIntro: Testing SIG
33mWho broke the build? Using Kuttl to test and Release faster
17mIntroduction to Spinnaker on Kubernetes
52mContinuous Deployment to the Cloud using Spinnaker
18mOvercoming the challenges of using Spinnaker as a multi-tenant CD service
38mContinuous deployment at Skyscanner
36mSuccessful Kubernetes Development Workflows