USER-FACING, REALTIME ANALYTICS USING APACHE PINOT

on YouTube ↗44m

" summary

Apache Pinot is a distributed OLAP store that ingests from Kafka Kinesis or Pulsar and serves queries from in-memory segments then flushes to deep storage; clusters report over a million events per second ingestion and milliseconds latencies at tens of thousands of QPS. It uses brokers servers and a controller for routing and coordination, offers inverted range text geospatial and star tree index and json index, supports transform UDFs at ingest or query time, and powers LinkedIn Who Viewed My Profile Feed and UberEats dashboards.

AI-written summary · about

" chapters (17)

1. 0:00Start
2. 0:52About Me
3. 2:12Evolution of Real Time Analytics
4. 3:22User-facing Real Time Analytics
5. 4:39Who Viewed My Profile
6. 6:15UberEats Restaurant Manager
7. 7:17Challenges of user-facing realtime analytics
8. 8:53Analytics Landscape
9. 11:24Apache Pinot Community
10. 12:09Apache Pinot Architecture
11. 14:52Demo
12. 24:39UDFs for Ingestion Transformation & Query
13. 25:11User-facing realtime analytics using Pinot
14. 29:03Star-tree index benchmarks
15. 29:24JSON Index
16. 31:21Partitioning
17. 33:05Takeaway

" related talks

• 49mIntroduction to Real-Time Analytics with Apache PinotTim Berglund · GOTO Chicago 2023
• 54mAn Introduction to Apache PinotTim Berglund · Devnexus 2022
• 47mReal-time analytics for your users with Apache PinotF. Teychene · DevOps D-Day 2022
• 47mReal-time Analytics for Your Users with Apache PinotFrançois Teychene · Devoxx France 2022
• 46mOptimizing Speed and Scale of User-Facing Analytics w Kafka and PinotK Wolok, T Berglund · Voxxed Days Zürich 2022
• 34mNext generation OLAP stack using Apache PinotChinmay Soman · Berlin Buzzwords 2022
• 34mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotMark Needham, Karin Wolok · Open Source Summit Latin America 2022
• 29mRealtime Analytics Unleashed: Unlocking the Potential of Data at ScaleBarkha Herman · Shift Miami 2023