Tame Kafka streams with Clojure
summary
A live demo uses Kafka Streams with a Clojure REPL to build a working topology end to end: a word‑count example that writes correct lengths to an output topic and a production-style reconciliation pipeline that joins transactions and repayments and marks reconciled items. Configuration uses JVM interop, Avro schemas and a schema registry, Docker Compose for local clusters, and Vault for PII. Business logic stays as pure functions so it’s testable and reloadable in the Clojure REPL.
AI-written summary · about
chapters (28)
- 0:00Introduction
- 0:53Overview
- 2:00What is Kafka
- 3:54Kafka Components
- 5:18Partitions
- 5:48Consumer Groups
- 6:40Multiple Consumers
- 7:02Microservices
- 8:13Why Clojure
- 10:20Confluent graphs
- 17:07Real code
- 17:19Visual explanation
- 19:47Stream builder
- 22:13Valuemapper interface
- 22:51Show code
- 23:52Streams
- 27:25Reconciling
- 28:34Kafka Streams
- 29:22Data Flow
- 29:55Join and Compute
- 30:31Branch
- 30:58Business logic
- 32:55reconcile
- 34:00augmenting
- 34:23closing
- 35:22disaster recovery
- 40:33compliance
- 43:10durable messages
related talks
36mLiterate Stream Processing
33mKafka Microservices with Kafka plus Akka and Kafka Streams
01h 11mBootiful Stream Processing!
44mKafka based Microservices with Akka Streams and Kafka Streams
58mGame of Streams
01h 00mKafka for .NET Developers
44mFrom REST to CQRS with Clojure, Kafka, & Datomic
01h 02mKafka for .NET Developers