Apache Kafka as the Single Source of Truth: Usage, Problems, Pain and Consequences

on YouTube ↗45m

" summary

Examines using Apache Kafka not only as a messaging system but as the sole data storage for applications, describing practical usage patterns, problems encountered, operational pain points, and consequences of that choice. Covers trade-offs and real-world implications of treating Kafka as the primary persistence layer for high-load systems.

AI-written summary · about

" chapters (8)

1. 0:00Introduction
2. 3:59What is Apache Kafka
3. 9:40Kafka as data store
4. 13:56Kafka backup problems
5. 20:20MirrorMaker backups
6. 22:48Kafka storage pros and cons
7. 26:22System improvements
8. 30:17Q&A

" related talks

• 53mDemystifying KafkaNakul Mishra · JDD 2019
• 54mApache Kafka as a Foundation for Building BicyclesNikolay Sivko · HighLoad++ Moscow 2018
• 01h 10mApache Kafka: What It Is and How It Will Change Your Application ArchitectureIvan Ponomarev · HolyJS Piter 2020
• 17mOvercome By Events - Apache Kafka And Event-oriented ArchitectureJay Kreps · Big Data LDN 2018
• 29mApache Kafka and the Next 700 Stream Processing SystemsJay Kreps · Strange Loop 2015
• 13mKeynote – Jay KrepsJay Kreps · PGConf Silicon Valley 2015
• 39mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia Europe 2020
• 41mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia November 2020