Apache Kafka in 1 hour for C# Developers

on YouTube ↗55m

" summary

Shows a working C# pipeline: Patreon webhooks -> Azure Function HTTP trigger -> Confluent Cloud Kafka topic, produced and consumed with KafkaFlow on .NET. Covers concrete knobs: partitions and keys for ordering, replication and acks for durability, batch publishing, multi-threaded consumers, compaction vs retention, and storing offsets. Demonstrates deduplication with Azure Table, SendGrid for emails and a GitHub provisioning consumer, and notes demo fragility during an Azure outage. Includes code wiring via DI and practical runtime numbers like offsets and consumer lag.

AI-written summary · about

" chapters (12)

1. 0:00Introduction
2. 2:50Why C# focus
3. 10:19Kafka fundamentals
4. 15:11Kafka with Confluent Cloud
5. 18:21Producers and message keys
6. 25:50Patreon events with Kafka Flow
7. 31:10Middleware pipeline
8. 34:27Producer acknowledgments
9. 39:19Consumer groups
10. 45:04Kafka as messaging and database
11. 46:29Topic retention policies
12. 50:02Live demo

" related talks

• 49mApache Kafka in 1 hour for C# DevelopersGui Ferreira · NDC Porto 2023
• 53mApache Kafka in 1 hour for C# DevelopersGuilherme Ferreira · Copenhagen Developers Festival 2023
• 01h 03mApache Kafka Event streaming platform for .NET developersViktor Gamov · NDC Sydney 2019
• 26mConnecting distributed data with Apache KafkaJacob Bogie, TJ Laher · Azure Cosmos DB Conf 2022
• 35mApache Kafka as a Monitoring Data PipelineJakub Scholz · DevConf.CZ 2021
• 01h 00mKafka as a Platform: the Ecosystem from the Ground UpRobin Moffatt · NDC Oslo 2020
• 14mPower real-time data streams from anywhere to Cosmos DB with ConfluentFlorence Sullivan · Microsoft Build 2023
• 39mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia Europe 2020