Go for Real Time Streaming Architectures
summary
Argues for writing lightweight, cloud‑native streaming components in Go that connect to Kafka (using Sarama) and scale with Kafka consumer groups, cross‑compile into minimal docker container images and run under Kubernetes. Claims showable numbers: thousands of messages per second per worker. Describes building standalone console services, using Go concurrency to parallelize per‑partition work, replacing heavy Java/Scala frameworks, and deploying by increasing replication to match topic partitions.
AI-written summary · about
chapters (5)
related talks
29mGo Big with Apache Kafka
25mBeyond Kafka: Leveraging Event-Driven Architectures with Go and NATS JetStream
28mManaging and Scaling Real Time Data Pipelines using Go
54mComplex Concurrency Patterns with Go
46mSimplifying Scalable Cloud Application Development with Go
31mBuilding a microservices architecture with Go
47mStream All the Things!
30mEvent Streaming and the Future of Applications