Taming Apache Kafka Using GitOps
summary
Deploys Apache Kafka on Kubernetes using Strimzi operator and syncs cluster, topics and users from Argo CD via Git repo manifests; demo shows a 3‑broker Kafka cluster (ZooKeeper backend), Helm charts creating topics and secrets, and a permission change applied through a pull request that immediately allows a previously blocked consumer to read—everything works. Notes include resource tuning for large fleets (example: running 15 Kafka clusters required increasing the operator JVM resources) and using MirrorMaker for cross‑cluster replication.
AI-written summary · about
chapters (9)
- 0:00Introduction and context
- 3:13Data streaming and GitOps overview
- 7:52StreamZ Kafka Kubernetes operator
- 11:49GitOps methodology explained
- 17:32Argo CD GitOps controller demo setup
- 20:04Live demo Kafka cluster creation
- 26:30Demo Kafka users and topics
- 33:16Demo Kafka permissions and pull requests
- 34:19Key takeaways and resources
related talks
50mRunning Apache Kafka on Kubernetes and OpenShift
26mProduction Grade Kafka on K8s
42mTransition to Apache Kafka on Kubernetes With Strimzi
31mSimplifying Apache Kafka on Kubernetes With Strimzi
33mApache Kafka Devops with Kubernetes and Gitops
33mKafka Operator: Managing and Operating Kafka Clusters in Kubernetes [A]
29mKafka on Kubernetes: Does it really have to be the hard way?
31mEvent driven communication with Kafka on Kubernetes
