Managing Application Events in the Cloud
summary
A case study from seedtag on building an events-management and reporting pipeline for a microservices-based system to track product metrics and billing. It describes evaluated architectures, what worked or needed changes, and the final Google Cloud–based solution that now processes over 3 TB of events per day.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 3:38Event needs
- 7:58Tech options
- 18:56BigQuery Streaming choice
- 21:30Kafka and Spark Streaming switch
- 24:22Final Kafka Spark architecture
- 32:12Additional tools hiring
- 36:52Q&A
related talks
55mCloud Analytics: from 0 to 100,000 events per second in 50'
31mUsing Telemetry in Cloud Native Applications
37mBuilding Event-driven Apps at Scale
19mLog Events @ Twitter: Challenges of Handling Billions of Events per Minute
27mEvent Processing at Optum, the Cloud Events Way
27mEvent-driven Digital Transformation
29mEvent streaming with modern data pipelines in a SaaS architecture
01h 09mExploring Flow Architectures