Highly Available Git on CephFS with Rook, Kubernetes, and OpenStack
summary
OpenDev replaces an eight-VM, shared-nothing git farm with a reproducible, shared-everything stack: Kubernetes on OpenStack bootstrapped by kubernetes-on-openstack Ansible playbooks (1 master + 3 minions), CephFS on Rook using the Rook operator to provision mons and OSDs on 80GB extra volumes attached to each minion, Percona XtraDB cluster for the database, and Octavia for ingress. BlueStore min_alloc is tuned to 4K BlueStore min_alloc for many small git files. Deployment finishes in ~15 minutes and the filesystem mounts and serves repositories.
AI-written summary · about
chapters (16)
- 0:00Introduction to OpenDev
- 1:33Why OpenDev uses free tools
- 3:27Current Git hosting setup issues
- 4:31Moving to shared everything architecture
- 6:00Deploying Kubernetes on OpenStack
- 9:37Automating Kubernetes deployment
- 15:19Setting up Rook and CephFS
- 18:35Configuring Rook for CephFS
- 24:21Creating CephFS filesystem
- 27:59Exploring CephFS with toolbox
- 31:41Deploying Percona XtraDB
- 33:16Integrating CephFS with GitT
- 35:03Deploying GitT on Kubernetes
- 36:48Live demo of OpenDev Git hosting
- 37:50Open-source stack summary
- 38:12Q&A
