How We Built a Cloud On K3s: The Learnings Of Growing Up Fast
Talkat KubeCon + CloudNativeCon North America 2021 · on Thursday, 2021-10-14· at 17:25· Room 502 AB + Online·
summary
Civo builds a managed cloud on k3s by packing tenant k3s clusters as VMs run inside pods using libvirt + kubevirt VMs, deployed on zero‑touch open‑compute superclusters of 32 compute nodes with 4 control‑plane nodes each and distributed node pools. Clusters launch in 90 seconds (working toward sub‑60), networking uses a per‑tenant router pod with dual NICs and dynamic firewall rules, and observability is unified with Prometheus Loki Jaeger Thanos. They shift to workspace Terraform/Terragrunt and gated pipelines to automate rollouts and reduce toil.
AI-written summary · about
chapters (14)
- 0:00Intro
- 0:54What is Civo
- 2:50What is K3s
- 3:31Why K3s
- 4:18Civo Infrastructure
- 5:22K3s Clusters
- 6:18Hot Plug Technology
- 6:42Networking
- 7:37Tenant Clusters
- 8:17Learnings
- 8:44Deployment maturity
- 10:03Observability maturity
- 11:38Culture maturity
- 14:12Summary
related talks
35mMulti-Tenancy on Kubernetes with Virtual Clusters
28mHow We Tackle KubeVirt’s Growth and Scalability
37mVirtual Clusters in the Real World: Lessons from k3k’s Journey to Production
27mElastic cloud bursting with Virtual Kubelet and KIP
43mSingle-node Kubernetes Clusters Using K3s with Benefits of GitOps
01h 22mWorkshop: Optimizing Kubernetes Cluster Scaling for Adv...
23m08 Kubernetes and the cloud. Um, what's the cloud?
25mHow We Run Kubernetes in Kubernetes, aka Kubeception [I]