ToroDB Stampede: open-source BI connector for MongoDB
summary
ToroDB Stampede is an open-source secondary replica that reads MongoDB oplogs, auto-generates relational schema and writes live relational tables to a downstream RDBMS (Postgres today, experimental MySQL), claiming typical speedups of 100x faster for analytics and reporting versus direct MongoDB or the MongoDB BI Connector. It performs an initial sync then tails the oplog, supports sharded sets, auto-adds nullable columns on schema drift, resolves type conflicts by creating suffixed type columns, and ships under AGPL requiring Java 8 and a Postgres/MySQL backend.
AI-written summary · about
chapters (9)
- 0:00Introduction to ToroDB
- 3:08Architecture and data mapping
- 7:26Dynamic schema and replication
- 10:57Performance benchmarks
- 16:25Data discoverability
- 18:01Head-to-head comparison
- 23:14BI tool integration tests
- 26:59MySQL support announcement
- 29:08Q&A and conclusion
related talks
01h 04mToroDB: NoSQL & relational Java database with SQL analytics
54mBreakout Session
48mToroDB scaling PostgreSQL like MongoDB
48mToroDB scaling PostgreSQL like MongoDB
46mStreaming ETL on the Shoulders of Giants
04mDave Stokes Talks Open - Episode 5
42mFrom MongoDB to Postgres: Building an Open Source Standard for Document Databases
14mBuild your data lakehouse with Starburst Galaxy
