Real-Time Analytics: Going Beyond Stream Processing with Apache Pinot
Talkat Open AI + Data Forum @ Open Source Summit North America 2022 · on Tuesday, 2022-06-21· at 16:05· Room 408/409 (Level 4), JW Marriott Austin, 110 E 2nd Street Austin, TX 78701·
summary
Apache Pinot is presented as a low-latency analytics store for real-time analytics, designed to ingest streaming sources and provide fast slice-and-dice queries for dashboards and OLAP use cases. The talk covers how Pinot complements stream-processing systems by offering indexing, aggregation, and high-throughput query execution to support sub-second dashboards and real-time anomaly detection at scale.
AI-written summary · about
chapters (20)
- 0:00Start
- 1:36Machine Learning
- 3:09Actionable Insights
- 4:14Examples of Real-Time Analytics
- 8:30Evolution of Real-Time Analytics
- 9:55User-Facing Analytics
- 11:57Semi-Structured Data Support
- 14:45Data-Size Explosion
- 15:36Requirement Changes to OLAP Systems
- 15:57What is Apache Pinot?
- 16:43Apache Pinot - Columnar Store
- 17:21Apache Pinot-Higher-level Architecture
- 18:00Apache Pinot-Features
- 19:01Pruning: Smart query dispatch
- 20:32Segments: Designed for low latency
- 22:16Indexes: All supported index optimization in Pinot
- 25:50UPSERT Ingestion Example
- 30:14Tightly-coupled Storage & Compute
- 30:57Decoupled Storage & Compute
- 31:27Takeaways
related talks
49mIntroduction to Real-Time Analytics with Apache Pinot
47mReal-time analytics for your users with Apache Pinot
47mReal-time Analytics for Your Users with Apache Pinot
31mReal-time Analytics: Going Beyond Stream Processing With Apache Pinot
34mReal-Time Analytics: Going Beyond Stream Processing with Apache Pinot
44mUSER-FACING, REALTIME ANALYTICS USING APACHE PINOT
34mNext generation OLAP stack using Apache Pinot
46mOptimizing Speed and Scale of User-Facing Analytics w Kafka and Pinot