Introduction to Real-Time Analytics with Apache Pinot

on YouTube ↗49m

" summary

Apache Pinot is a real‑time, distributed analytics DB that sits on Kafka and serves user‑facing features (LinkedIn feed, Uber Eats) by ingesting events into in‑memory consuming segments and immutable disk segments, then scattering queries via brokers to servers. It targets 100k+ queries/sec with sub‑100 ms latency and second‑level freshness, supports forward/inverted/text/geo(JSON/H3) indexes and a precomputed StarTree index, and is proven in production for low‑latency, high‑concurrency analytics.

AI-written summary · about

" chapters (8)

1. 0:00Intro
2. 2:06Revolution
3. 9:22A taxonomy of analytics
4. 20:34Data model
5. 20:58Query language
6. 22:38Pinot architecture
7. 42:23Indexes
8. 48:57Outro

" related talks

• 54mAn Introduction to Apache PinotTim Berglund · Devnexus 2022
• 44mUSER-FACING, REALTIME ANALYTICS USING APACHE PINOTNeha Pawar · Crunch Conference 2021
• 47mReal-time analytics for your users with Apache PinotF. Teychene · DevOps D-Day 2022
• 38mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotKarin Wolok, Rong Rong · Open AI + Data Forum @ Open Source Summit North America 2022
• 47mReal-time Analytics for Your Users with Apache PinotFrançois Teychene · Devoxx France 2022
• 34mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotMark Needham, Karin Wolok · Open Source Summit Latin America 2022
• 34mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotMark Needham, Karin Wolok · Open Source Summit Latin America 2022: Open AI + Data Forum
• 46mOptimizing Speed and Scale of User-Facing Analytics w Kafka and PinotK Wolok, T Berglund · Voxxed Days Zürich 2022