Conformance Testing the Kubernetes API: Tooling that Makes the Difference

on YouTube ↗20m

" summary

Conformance work uses a small toolchain: apisnoop.cncf.io (snoop DB + audit logger + web) ingests OpenAPI and audit logs to find untested endpoints, while peer.sharing.io spins disposable Kubernetes dev clusters for live test writing and pairing. The team documents tests in Emacs org mode, exports to GitHub issues, runs e2e focused genko tests, and tracks coverage numbers — currently about 77% conformance with roughly 402 endpoints showing full coverage.

AI-written summary · about

" chapters (9)

1. 0:00Introduction and context
2. 0:40Kubernetes conformance
3. 1:30Conformance testing tools
4. 2:59Setting up peer environments
5. 5:20Inside the development pod
6. 7:24Documenting tests with Emacs
7. 12:10Exporting and sharing results
8. 14:44Testing existing endpoints
9. 17:17Conclusion and resources

" related talks

• 23mContributing to Kubernetes Conformance CoverageCaleb Woodbine, Hippie Hacker · KubeCon + CloudNativeCon North America 2020 Virtual
• 27mAdventures in ConformanceAaron Crickenberger · KubeCon + CloudNativeCon China 2018
• 32mIntro + Deep Dive: Kubernetes Conformance WGSrinivas Brahmaroutu, Dan Kohn · KubeCon + CloudNativeCon + Open Source Summit China 2019
• 16mContributing to Kubernetes Conformance CoverageCaleb Woodbine, Zach Mandeville · KubeCon + CloudNativeCon Europe 2021
• 36mKubernetes Conformance WG Intro – William DennissWilliam Denniss · KubeCon + CloudNativeCon Europe 2018
• 21mFilling the Gaps in Kubernetes Test CoverageHippie Hacker · Kubernetes Forum Seoul 2019
• 01h 27mIntro + Deep Dive: Kubernetes Conformance WGWilliam Denniss, Dan Kohn, Aaron Crickenberger · KubeCon + CloudNativeCon Europe 2019
• 35mK8s Conformance & SIG Architecture Conformance SubgroupJohn Belamaric, Dan Kohn, Hippie Hacker · KubeCon + CloudNativeCon North America 2019