Event-driven applications: Apache Kafka and Python
summary
Shows Apache Kafka used from Python with runnable Jupyter notebooks and the kafka-python client, creating topics, producing and consuming JSON records, demonstrating partitioning, ordering, consumer group assignment and offsets. Demo deploys an Aiven managed cluster (google cloud europe germany), creates topics with replication factor 3 and multi‑partition layouts, verifies messages arrive and consumers split work, and wires Kafka Connect to move data to sinks. Includes code, a fake pizza event generator, notes on Avro/Protobuf and a redeemable 300 of free credit.
AI-written summary · about
chapters (19)
- 0:00Intro
- 0:37Event-Driven Applications
- 0:58Why Event-Driven?
- 3:16What is Kafka?
- 4:11Distributed
- 5:02What is a Kafka Event?
- 6:20Write to Kafka
- 6:51Read from Kafka
- 7:47Pizza Demo!
- 12:08Log Size
- 12:44Topic Partitions
- 13:33Selecting a Partition
- 13:47Ordering
- 14:54Scaling Out
- 16:14Partitions Demo!
- 19:05Multiple Applications
- 22:03Consumer Groups Demo!
- 22:50Kafka Connect
- 24:10Resources
related talks
38mEvent-driven applications: Apache Kafka and Python
45mEvent-Driven applications: Apache Kafka and Python
40mUsing Kafka in Your Python Applications
27mReal-time Event Streaming with Python
01h 03mApache Kafka Event streaming platform for .NET developers
37mEverything you Wanted to Know about Apache Kafka but you Were too Afraid to Ask!
48mBuilding a Microservice Application Using Kafka and Django
25mAsynchronous and Broadcasting APIs using Kafka