Apache Kafka Event streaming platform for .NET developers
summary
Argues Apache Kafka is a full event-streaming platform built on a log backbone that gives durable, ordered storage and partitioned scaling (consistent-hash partitioning across brokers, thousands of partitions possible). Shows the Confluent.Kafka .NET client and Kafka Connect (Twitter connector) producing real live tweets into topics, then uses ksqlDB stateful windows (example: 5-minute window, alert if >3 auth attempts) to detect fraud and update counts; demo runs on Kubernetes, replays history and displays emojis, with live tweeting proving the pipeline end-to-end.
AI-written summary · about
chapters (40)
- 0:00Introduction
- 2:42Building software
- 3:47Typical enterprise architecture
- 6:19What is event streaming platform
- 6:52How event streaming platform evolved
- 8:34What you need to know
- 11:32Log
- 15:02Queue
- 21:13Consumption
- 21:39Random Access
- 22:15Consumer Groups
- 27:38Summary
- 28:31Kafka Connect
- 30:00Deployment
- 30:25Data replication
- 30:56Kafka partitions
- 32:59Demo
- 34:48Confluence CLI
- 35:35HDInsight
- 42:16Kafka Client
- 44:13Kafka Processing
- 45:44Fraud Protection
- 47:09Stream Processing
- 50:07Stateful Processing
- 50:23Everyone knows Java
- 50:50Control Center
- 51:15REST interface
- 51:57Headless mode
- 52:17Interaction
- 53:05Key sequel
- 53:16How it works
- 53:34Multiple things running
- 54:04Continuous query
- 54:47Fake Twitter
- 55:36Wheres my tweet
- 55:52What a loser
- 56:14Emojis
- 57:38Stream processing application
- 58:33User tweet count
- 59:17User tweet table
related talks
55mApache Kafka in 1 hour for C# Developers
53mApache Kafka in 1 hour for C# Developers
01h 02mKafka for .NET Developers
37mEverything you Wanted to Know about Apache Kafka but you Were too Afraid to Ask!
49mApache Kafka in 1 hour for C# Developers
01h 00mKafka as a Platform: the Ecosystem from the Ground Up
39mKafka as a Platform: The Ecosystem from the Ground Up
01h 00mKafka as a Platform: the Ecosystem from the Ground Up