Building a Distributed Data Ingestion System with RabbitMQ
summary
A concrete recipe for sending global telemetry: RabbitMQ plus the Federation plugin replicates exchanges and queues transparently so apps need no code changes, and sharding uses a router to split traffic across nodes. The talk shows a working simulator and basic‑Q demo (500 messages, prefetch 5, 4 consumers) and explains tradeoffs — sharded queues partition by consistent hash and you tune replication with configurable max_hops message_ttl prefetch_count to avoid local buffer bloat.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 1:13Paris
- 6:20Java
- 6:37Java Client
- 10:18Messaging
- 17:03Graphics
- 17:53Sending data
- 22:08Unbound local buffer
- 23:38Federation
- 27:48Configuration
- 30:03Quality of Service
- 31:58BasicQueue Simulator
- 34:08Queueing Theory
- 36:43Scheduling and Queue
- 41:58Partition
related talks
19mBuilding a Distributed Data Ingestion System with RabbitMQ
03mBuilding a Distributed Data Ingestion System with RabbitMQ
01h 19mBuilding a Distributed Data Collection System with RabbitMQ
32mBuilding distributed system for retail with RabbitMQ
48mA Beginner's Guide to Inter-Service Messaging
39mReal World RabbitMQ: Exploring Practical Applications
40mBuilding Scalable Resilient IoT Messaging
01h 05mScaling Applications with RabbitMQ