Interview

on YouTube ↗06m

" summary

Describes building production streaming platforms using Alpakka Kafka connector to wire Kafka into processors like Spark, Kafka Streams and Akka Streams, and explains actual use of Kafka features: consumer groups, transactions and exactly-once semantics. Shows the Fast Data Pipelines product that composes processors into one platform, explains how connectors and transactional offsets are implemented, cites contributions to Reactive Kafka and Alpakka, and reports working demos and real-world deployment experience.

AI-written summary · about

" related talks

• 06mJay Kreps interviewJay Kreps · Data By the Bay 2016
• 50mApplication development and data in the emerging world ...Neha Narkhede · Berlin Buzzwords 2016
• 03h 00mStream Processing, Going Beyond Pub/Sub with Kafka Streams and...F. Ramière, D Petisme · Devoxx France 2021
• 50mIntroduction to Apache KafkaJames Ward · Devoxx US 2017
• 01h 29mEvent stream processing using Kafka StreamsFredrik Vraalsen · Berlin Buzzwords 2018
• 41mKafka as a Platform: the Ecosystem from the Ground UpRobin Moffatt · ApacheCon@Home 2021
• 39mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia Europe 2020
• 01h 00mIn Depth Kafka StreamsDaniel Hinojosa · Devnexus 2020