Go Big with Apache Kafka
summary
Introduces a Go producer and consumer using the Confluent Go client and mentions sarama, shows code that serializes machine sensor structs to JSON and to Avro via a generated Go struct, and wires messages to Kafka topics with partitions, consumer groups and replication factors explained. Notes the practical 1 MB message limit on payloads, demos schema evolution with an Avro schema and a carapace schema registry, and recommends kafkacat and kafdrop for debugging plus an example repo for Thingam Industries.
AI-written summary · about
chapters (10)
- 0:00Apache Kafka intro
- 2:20Kafka fundamentals & use cases
- 7:15Kafka with Go apps
- 13:15Kafka CLI & UI tools
- 15:01Schemas in Kafka
- 19:36Safe Avro schema evolution
- 21:19Avro schema registry in Go
- 22:44AsyncAPI for event docs
- 25:57Why Kafka fits Go
- 26:39Resources & closing
related talks
50mIntroduction to Apache Kafka
41mKafka as a Platform: the Ecosystem from the Ground Up
36mApache Kafka Simply Explained
39mKafka as a Platform: The Ecosystem from the Ground Up
05mGo for Real Time Streaming Architectures
39mAn introduction to Apache Kafka - this is Event Streaming, not just Messaging
41mKafka as a Platform: The Ecosystem from the Ground Up
54mKafka as a Platform: the Ecosystem from the Ground Up