Spinning up micro-services using Ruby/Kafka

on YouTube ↗11m

" summary

Argues a concrete pattern for splitting a Rails monolith: centralize event publishing in a model concern publisher that attaches metadata and serializers, send events to Apache Kafka, and consume them with Karafka + Sidekiq bridge into thin controllers. Implements a notification microservice that reads user-created events and sends a welcome SMS flow using phone number from the message. Provides a live signup demo showing Kafka messages, Sidekiq workers and controller logs — the example runs end to end locally.

AI-written summary · about

" chapters (6)

1. 0:00The challenges of monoliths
2. 1:20Decoupling with events
3. 3:38Introducing Apache Kafka
4. 5:20Implementing producers
5. 7:52Processing with consumers
6. 8:58Live demo and conclusion

" related talks

• 11mSpinning up micro-services using Ruby/KafkaAnkita Gupta · Red Dot Ruby Conference 2017
• 35mApplying microservices patterns to a modular monolithGuillermo Aguirre · RailsConf 2023
• 31mEvent Streaming on RailsBrad Urani · RailsConf 2022
• 27mScaling a Rails Monolith w/Event Driven MicroservicesMarko Anastasov · WindyCityRails 2016
• 38mEffective Data Synchronization between Rails MicroservicesAustin Story · RailsConf 2021
• 27mEvent Streaming Patterns for Ruby ServicesBrad Urani · RubyConf TH 2023
• 33mMicroservices, Events, and Breaking the Data Monolith with KafkaBen Stopford, Cornelia Davis · Cloud Foundry Summit Europe 2019
• 48mBuilding a Microservice Application Using Kafka and DjangoNikolay Saskovets · PiterPy 2019