DRb vs. RabbitMQ Showdown

on YouTube ↗36m

" summary

Company replaces DRb point-to-point RPC with RabbitMQ/AMQP using the ruby amqp gem and EventMachine to gain persistence and decoupling. They move transient FPS/quality stats to lightweight channels and send durable state-change events to durable queues, ensuring messages survive broker or management-node failures. Implementation scales to tens of nodes (up to ~120 messages/sec per heavy node), reduces coupling, adds packaging overhead for RabbitMQ/eventmachine gems, and shows strong throughput and resiliency in testing.

AI-written summary · about

" chapters (18)

1. 0:00Introduction
2. 1:12Elemental Technologies
3. 2:18Video streaming use cases
4. 5:08Ruby's role in the company
5. 6:28Initial architecture with DRB
6. 9:03DRB communication examples
7. 11:22File transcoding with DRB
8. 13:08Live streaming with DRB
9. 14:08Challenges with DRB
10. 16:08Defining the new solution
11. 18:42Adopting a message queue
12. 20:23RabbitMQ and AMQP
13. 21:40RabbitMQ with Ruby
14. 23:23System improvements
15. 25:47Final architecture
16. 27:10Implementation details
17. 28:29Results and conclusion
18. 30:21Q&A

" related talks

• 18mRuby Messaging PatternsGerred Dillon · Madison Ruby 2011
• 41mDecouple all the things: Asynchronous messaging keeps it simpleKerstin Puschke · ArrrrCamp 2015
• 54mKeynote: Bringing a Ferrari to a Horse RaceSophie deBenedetto, Steven Nunez · RabbitMQ Summit 2021
• 44mKeynote: Erlang Powered RabbitsLukas Larsson · RabbitMQ Summit 2022
• 33mFar and Away (A Tour of DistribRuted Programming with Ruby)Mark Bates · RubyConf 2010
• 17mFun, interesting and common RabbitMQ use casesLovisa Johansson · RabbitMQ Summit 2022
• 57mReliability NirvanaDaniel Selans · GopherCon 2021
• 41mHow We Rabbit at AWeberGavin Roy · RabbitMQ Summit 2022