Expressive Kafka Streams API for Scala Developers

on YouTube ↗31m

" summary

Wraps Kafka Streams Java API into idiomatic Scala, keeping original semantics while adding implicit Serdes so the compiler enforces missing serializers and removes repetitive type boilerplate. Provides a Scala-friendly DSL and a separate queryable-state HTTP service that discovers nodes via Kafka Streams metadata, queries each local store, and merges results to support distributed state lookups. Library is published on Maven and GitHub, many features are upstreamed into Apache Kafka, and the internal query library exists at version 0.1 and is production-used at the uploader's company.

AI-written summary · about

" chapters (6)

1. 0:00Introduction to streaming
2. 4:46Kafka Streams features
3. 10:51Scala API for Kafka
4. 17:54Implicit type safety
5. 22:57Queryable state library
6. 28:03Project status and closure

" related talks

• 35mBuilding a Real-time Streaming Platform Using Kafka Streams...Jay Kreps · Data By the Bay 2016
• 55mDemystifying Stream Processing with Apache KafkaEwen Cheslack-Postava · Philly ETE 2016
• 47mOne Does Not Simply Query a StreamViktor Gamov · Voxxed Days CERN 2025
• 48mStreaming all the things with Akka StreamsJohan Andrén · Voxxed Days Zurich 2017
• 50mIntroduction to Apache KafkaJames Ward · Devoxx US 2017
• 53mBuilding Event Driven Services with Apache Kafka and Kafka StreamsBen Stopford · Devoxx Belgium 2017
• 41mApache Kafka simply explainedOlena Kutsenko · Berlin Buzzwords 2022
• 53m(Spring) Kafka - one more arsenal in a distributed toolboxNakul Mishra · Spring I/O 2018