Distributed high-load BI engine for Google Data Studio and Microsoft Power BI
summary
A distributed, high-throughput cloud BI engine built to serve Google Data Studio and Microsoft Power BI is described, covering design, implementation and rollout to hundreds of thousands of companies. The talk compares and explains choices of columnar storage technologies — Druid, Pinot, ClickHouse and Amazon Redshift — and discusses errors, pitfalls and operational lessons learned during development and launch.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 6:47Why business analytics
- 14:51Problems and first attempts
- 20:29Simple BI engine solution
- 27:55Google Data Studio integration
- 31:04Power BI integration
- 33:12Yandex.Dashboards integration
- 38:10Q&A
related talks
36mThe Power of Consolidation: A Unified Stack for Business Intelligence, Securi...
37mBuilding a Data Platform from scratch
26mETL pipeline with GCP Dataflow
17mUsing MariaDB ColumnStore with Power BI for Visualization and Reporting
06minterviewed – Paul Groom
43mData warehousing reinvented for today's needs
28mThe architecture behind modern cloud data warehouses
30mData Engineering building your BI infrastructure from scratch
