The rise and fall of the full stack database
summary
Claiming a practical path from monolith to polyglot, a replication system based on Kafka and Kafka Streams copies an Oracle dataset into specialized stores and it works in production after a hard rollout. For Sportlink the team moves half a billion rows of relational history to MongoDB then to search and graph backends, serving 1 million players and 40,000 weekly matches. Kafka Streams forces large state in RocksDB and warmups take hours or days, but Elasticsearch, Neo4J and Firebase plug in as views on the same data.
AI-written summary · about
chapters (8)
- 0:00Start
- 16:52Challenge
- 18:43MongoDB
- 18:55Stream Processing
- 20:36Development cycle
- 21:26Conclusions
- 22:58ELASTICSEARCH
- 24:30FIREBASE REALTIME
related talks
32mDiscover the Modern Way to Build Real-Time Analytics Solutions at Any Scale
47mElasticSearch, MongoDB and Neo4j walk into a bar a tale of different databases
34mChasing the Stream Processing Utopia
33mKafka streams at scale
39mModern Event-driven Architecture: Adopting Data in Motion
12mPower a Better Future
39mKafka as a Platform: The Ecosystem from the Ground Up
40mThe Seven Deadly Sins of Streaming