Challenges in Implementing a Distributed Messaging System

on YouTube ↗39m

" summary

Practical guidance for building a scalable, reliable distributed message-sending service in .NET, covering the Confluent Kafka .NET client features, using System.Threading.Channels as an in-process Pub/Sub to improve throughput, trade-offs and limits of Minimal APIs, and a comparison of gRPC versus HTTP to choose the best protocol for specific scenarios.

AI-written summary · about

" chapters (14)

1. 0:00Messaging intro
2. 1:30Messaging architecture
3. 4:06Campaign service
4. 8:51Message timeout handling
5. 12:11Minimal API
6. 15:48File handling in API
7. 20:34gRPC vs HTTP files
8. 27:50gRPC in microservices
9. 30:10System scaling
10. 31:55Hybrid cloud integration
11. 33:20Message processing speed
12. 34:25gRPC vs HTTP project
13. 35:30gRPC contract generation
14. 37:23gRPC use cases

" related talks

• 56mDistributed Messaging patternsCecil L. Phillip · AzConf 2020
• 01h 02mKafka for .NET DevelopersIan Cooper · NDC Sydney 2024
• 53mApache Kafka in 1 hour for C# DevelopersGuilherme Ferreira · Copenhagen Developers Festival 2023
• 01h 03mApache Kafka Event streaming platform for .NET developersViktor Gamov · NDC Sydney 2019
• 01h 05mKafka for .NET DevelopersIan Cooper · NDC London 2024
• 05mGo for Real Time Streaming ArchitecturesMickaël Rémond · dotGo 2017
• 01h 11mEmbracing Messaging and Eventual Consistency in your Microservices SolutionsMichele Bustamante · NDC Porto 2019
• 01h 00mKafka for .NET DevelopersIan Cooper · NDC Oslo 2024