Event Streaming and the Future of Applications

on YouTube ↗30m

" summary

Argues that Apache Kafka is both messaging and storage, running across hundreds of machines and holding hundreds of terabytes, with an immutable audit trail that enables replayability of events to fix corrupt data. Describes a real New York Times pipeline using a single "monologue" topic (content since 1851) plus a denormalizer that rewinds and rebuilds views successfully. Shows stream processors joining order, payment and customer streams to emit emails and pairs those prepared streams with serverless functions for elastic, pay‑per‑use execution.

AI-written summary · about

" chapters (12)

1. 0:00Introduction
2. 1:04Industry trends
3. 4:22Event streaming capabilities
4. 5:53The essence of events
5. 8:34Immutable storage model
6. 11:57Replayability and analytics
7. 13:29Event streaming use case
8. 15:32Decoupling microservices
9. 17:59Real-time stream processing
10. 20:44Serverless paradigm
11. 23:20Serverless and streams
12. 25:59Summary and conclusion

" related talks

• 17mOvercome By Events - Apache Kafka And Event-oriented ArchitectureJay Kreps · Big Data LDN 2018
• 27mKeynote II: Kafka and the Rise of Event-Driven MicroservicesNeha Narkehede · Scale By The Bay 2018
• 36mStream All The Things!Dean Wampler · Scale By the Bay 2017
• 55mDemystifying Stream Processing with Apache KafkaEwen Cheslack-Postava · Philly ETE 2016
• 16mAn introduction to Apache Kafka - this is Event Streaming, not just MessagingKatherine Stanley · Voxxed Days Microservices 2019
• 41mApache Kafka simply explainedOlena Kutsenko · Berlin Buzzwords 2022
• 43mEvent Streams & Data Rapids: Harnessing the Full Power of Messaging Platforms.Mark Heckler · Devoxx Ukraine 2022: Secure our Future
• 50mIntroduction to Apache KafkaJames Ward · Devoxx US 2017