Application Design Patterns on Apache Kafka
summary
Covers how to design reliable processing pipelines made of many components using Apache Kafka. Explains core design principles and architectural patterns for queues, back-pressure, integrating Kafka with HTTP, handling message loss, and processing tasks with widely varying execution times.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 7:53Request-Reply pattern
- 14:16HTTP client with queue pattern
- 20:37Large message framing pattern
- 26:37Error handling pattern
- 30:12Traffic logging
- 33:45Kafka Streams principles
- 42:24Other Kafka use cases
- 43:09Q&A
related talks
50mBuilding Data Streaming Platform with Apache Kafka
01h 10mApache Kafka: What It Is and How It Will Change Your Application Architecture
59mBuilding Data Intensive Microservices with Apache Kafka
19mAI Workflows with Kafka and Modern Architectures
27mHow to Scale Your Services with Kafka
33mKafka Microservices with Kafka plus Akka and Kafka Streams
16mIntroducing Apache Kafka
16mAn introduction to Apache Kafka - this is Event Streaming, not just Messaging