Apache Kafka simply explained

on YouTube ↗41m

" summary

Explains that Apache Kafka is a distributed, scalable event-streaming platform that handles millions of records per day and stores petabytes persistently, demonstrates a Java producer and consumer sending JSON events in a while‑loop to a single topic, shows key-based partitioning to guarantee per-customer ordering, and runs live demos where consumers print records and ordering is preserved; covers brokers, partitions, replication (recommend replication factor three), schema registry, connectors (OpenSearch example) and Kafka Streams, and points to a GitHub repo and managed cluster to reproduce the demos.

AI-written summary · about

" chapters (10)

1. 0:00Introduction to Apache Kafka
2. 1:46Motivation and architecture
3. 6:11Key Kafka concepts
4. 10:34Producers and consumers
5. 13:21Topics and records
6. 17:07Practical coding demo
7. 21:06Brokers and partitions
8. 29:16Replication and durability
9. 31:20Best practices and ecosystem
10. 34:35Q&A session

" related talks

• 50mIntroduction to Apache KafkaJames Ward · Devoxx US 2017
• 53mDemystifying KafkaNakul Mishra · JDD 2019
• 16mIntroducing Apache KafkaKatherine Stanley · Devoxx Belgium 2019
• 46mBrick-by-Brick: Exploring the Elements of Apache Kafka®Danica Fine · Berlin Buzzwords 2024
• 01h 31mDeveloping Real-Time Data Pipelines with Apache KafkaJoe Stein · SpringOne2GX 2015
• 53mBuilding Event Driven Services with Apache Kafka and Kafka StreamsBen Stopford · Devoxx Belgium 2017
• 55mDemystifying Stream Processing with Apache KafkaEwen Cheslack-Postava · Philly ETE 2016
• 35mBuilding a Real-time Streaming Platform Using Kafka Streams...Jay Kreps · Data By the Bay 2016