Apache Kafka in 1 hour for C# Developers

on YouTube ↗49m

" summary

Shows a working Patreon pipeline built with C#, Azure Functions, Confluent Cloud Kafka and KafkaFlow, with code and diagrams. Uses an HTTP webhook -> producer writing to topic "production-patron-events", sets message key=email to guarantee per-user ordering across partitions, and handles at-least-once delivery with idempotency in a sent-emails table. Deploys consumers with a configurable workers count (three threads example), chooses acknowledgements (none/leader/all tradeoffs), and stores current user state with compacted topics for a snapshot view.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 3:19Talk for C# developers
3. 7:59Kafka for Patron access
4. 15:07Topics partitions brokers
5. 25:25Producing with KafkaFlow
6. 31:26Consuming events
7. 37:00Evolutionary Kafka architecture
8. 43:27Consumer groups offsets
9. 47:48Snapshots cleanup policies
10. 48:31Summary

" related talks

• 53mApache Kafka in 1 hour for C# DevelopersGuilherme Ferreira · Copenhagen Developers Festival 2023
• 55mApache Kafka in 1 hour for C# DevelopersGuilherme Ferreira · NDC London 2023
• 01h 03mApache Kafka Event streaming platform for .NET developersViktor Gamov · NDC Sydney 2019
• 01h 02mKafka for .NET DevelopersIan Cooper · NDC Sydney 2024
• 01h 05mKafka for .NET DevelopersIan Cooper · NDC London 2024
• 01h 00mKafka for .NET DevelopersIan Cooper · NDC Oslo 2024
• 57mUsing Kafka for Real-Time Data Ingestion with .NETKevin Feasel · NDC Oslo 2018
• 26mConnecting distributed data with Apache KafkaJacob Bogie, TJ Laher · Azure Cosmos DB Conf 2022