Kafka as a Platform: the Ecosystem from the Ground Up
summary
Explains Apache Kafka as an immutable distributed commit log with topics, partitions and replica leaders, shows how producers and consumers use offsets and consumer groups to scale (one partition per consumer) and how retention and compaction policies control storage; demonstrates integration via Kafka Connect (JDBC, S3, HDFS connectors) and schema management with Schema Registry (Avro/Protobuf); outlines stream processing with Kafka Streams and ksqlDB, including stateful KTables rebuilt from changelogs and follower reads for availability.
AI-written summary · about
chapters (25)
- 0:00Introduction
- 1:20Events
- 7:27Topics
- 9:11Partitions
- 10:30Publish
- 13:58Read from Producer
- 20:58Kafka brokers
- 23:33Kafka fundamentals
- 24:41Kafka pipelines
- 26:59Kafka is a trap
- 27:32Kafka Connect
- 28:32Framework
- 29:02Connectors
- 29:35Data
- 30:14Serialisation
- 31:00Schema
- 31:23Schema Registry
- 32:20Data Consumption
- 32:53Consumer A
- 33:50Stream Processing
- 34:55KCDB
- 35:25Kafka Tools
- 36:20Kafka Events
- 37:55Learn More
- 38:12Questions
related talks
54mKafka as a Platform: the Ecosystem from the Ground Up
39mKafka as a Platform: The Ecosystem from the Ground Up
41mKafka as a Platform: The Ecosystem from the Ground Up
54mKafka: The Must Know Pub/Sub
46mBrick-by-Brick: Exploring the Elements of Apache Kafka®
01h 07mKafka Streams and KSQLDB
50mIntroduction to Apache Kafka
16mAn introduction to Apache Kafka - this is Event Streaming, not just Messaging