Introduction to Apache Kafka

on YouTube ↗50m

" summary

Apache Kafka is presented as an event ledger that keeps append‑only immutable records, guarantees ordering per partition, and replicates partitions (example replication factor 3), yielding near‑network throughput and linear horizontal scaling. A demo named "cuber" wires a Play web app, Mapbox maps, and browser websockets to Kafka; production components include Cassandra for long‑term storage and Flink for real‑time aggregation. Clients use reactive‑kafka with Akka Streams for pull‑based backpressure; JSON is used in demo but Avro/Protobuf are recommended. Delivery modes include at least once and effectively once.

AI-written summary · about

" chapters (14)

1. 0:00Start
2. 2:46EVENTS NOT TABLES
3. 4:36FIRST-CLASS PARTITIONING
4. 7:37LINEAR CLUSTERING PERFORMANCE
5. 8:09KAFKA FUNDAMENTALS
6. 9:27USE CASES
7. 14:53RECORDS
8. 16:21PRODUCERS & CONSUMERS
9. 17:03TOPICS & PARTITIONS
10. 18:37OFFSETS
11. 21:31PRODUCER PARTITIONING
12. 23:14CONSUMER GROUPS
13. 26:09DELIVERY GUARANTEES
14. 39:32BASIC CONNECTION

" related talks

• 41mApache Kafka simply explainedOlena Kutsenko · Berlin Buzzwords 2022
• 16mAn introduction to Apache Kafka - this is Event Streaming, not just MessagingKatherine Stanley · Voxxed Days Microservices 2019
• 39mAn introduction to Apache Kafka - this is Event Streaming, not just MessagingKatherine Stanley · Jfokus 2019
• 01h 31mDeveloping Real-Time Data Pipelines with Apache KafkaJoe Stein · SpringOne2GX 2015
• 39mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia Europe 2020
• 36mApache Kafka Simply ExplainedOlena Kutsenko · Devnexus 2022
• 16mIntroducing Apache KafkaKatherine Stanley · Devoxx Belgium 2019
• 41mKafka as a Platform: the Ecosystem from the Ground UpRobin Moffatt · ApacheCon@Home 2021