Thousands of Virtual Kubelets: 1-to-1 Mapping a Supercomputer To Kubernetes With Supernetes

on YouTube ↗30m

" summary

Supernetes performs a 1-to-1 mapping of Slurm nodes to v1/Nodes and Slurm tasks to v1/Pods, runs on LUMI, and tolerates strict HPC limits (no root, no namespaces, tight firewalls). Architecture uses an mTLS gRPC reverse tunnel from an agent on the login node to a controller that spawns thousands of virtual kubelets as Kubernetes nodes; FluxCD is patched for reconciliation (FluxCD patch). Demo shows ~103 virtual nodes and live sbatch↔pod sync working, with a 10s polling delay and unresolved networking, multi‑tenancy and HA issues.

AI-written summary · about

" chapters (11)

1. 0:00Introduction
2. 1:03Cloud vs HPC differences
3. 3:10Kubernetes and Slurm similarities
4. 6:24Bridging HPC and cloud
5. 7:07Superetes architecture
6. 10:18Live demo of Superetes
7. 14:09HPC-to-cloud bridges
8. 16:12HPC challenges
9. 20:03Future HPC and cloud
10. 23:36Conclusion
11. 24:40Q&A

" related talks

• 05mHow To Run Kubernetes Pods On My Slurm-Based HPC CenterDiego Ciangottini · KubeCon + CloudNativeCon Europe 2026
• 30mBuilding a Global Supercomputer with Virtual KubeletDmitry Mishin, Adrien Trouillaud · KubeCon + CloudNativeCon North America 2020 Virtual
• 31mVirtual What? Virtual Kubelet vs. Virtual NodeScott Coulton · Container Camp AU 2019
• 32mPods Everywhere! InterLink: A Virtual Kubelet Abstraction Streamlining HPC Resource ExploitationDiego Ciangottini · Cloud Native AI Day Europe 2024
• 28mKubeFlux: An HPC Scheduler Plugin for KubernetesClaudia Misale, Daniel Milroy · KubeCon + CloudNativeCon Europe 2022
• 36mIntro: Virtual KubeletRia Bhatia, Sravan Rengarajan · KubeCon + CloudNativeCon + Open Source Summit China 2019
• 36mIntroduction to Virtual Kubelet – Featuring Titus by NetflixSargun Dhillon, Ria Bhatia · KubeCon + CloudNativeCon North America 2019
• 35mMulti-Tenancy on Kubernetes with Virtual ClustersEnrico Candino · containerday 2025