Transactional Work with Topics
summary
Explains transactional operations on topics: what a topic is, transactional writes and transactional reads. Compares a model sharding task requiring ordering and exactly-once processing, showing why it cannot be solved in Apache Kafka without transactions, how YDB solves it without transactions, and how both systems handle it with transactions. Describes the transaction architectures in Apache Kafka and in YDB topics and compares their transactional performance.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 6:50Topic data model
- 10:18Kafka transaction structure
- 15:28IDB transaction structure
- 21:51Architecture comparison
- 24:21Performance comparison
- 27:30Future plans
- 37:13Q&A
related talks
30mAn approach to unite tables and persistent queues in one system
51mComparing the Scalability of Kafka and YDB Topics
43mBeing Transactional in 2019 — What Does That Actually Mean?
47mBeing transactional in 2019 - what does this actually mean?
46mYDB Topic Service: How We Improved Message Queue Performance
01h 00mParallel Asynchronous Replication b/t YDB Database Instances
40mDistributed Commit Log: Application Techniques for Transaction Processing
41mTransactions: myths, surprises and opportunities