Real-time analytics for your users with Apache Pinot

on YouTube ↗47m

" summary

Apache Pinot is demonstrated as a real-time analytics engine that delivers per-user, on‑demand analytics by ingesting Kafka streams and bulk CSVs. The demo shows Pinot querying and aggregating live streams on a single laptop—filtered aggregates over 148 million events in 134 ms, full scans of 148M in ~5.9 s, ~30 GB CSV ingest in ~40 minutes, and sustained realtime ingestion around 1M events/min with sub‑second 99th‑percentile latency for user-facing queries.

AI-written summary · about

" chapters (8)

1. 0:00Real-time analytics intro
2. 10:14Pinot overview and use cases
3. 11:18Cold data demo
4. 20:19Real-time ingestion and analytics
5. 27:08Bot analytics demo
6. 35:28Pinot architecture deep dive
7. 42:07Why adopt Pinot
8. 43:37Q&A

" related talks

• 34mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotMark Needham, Karin Wolok · Open Source Summit Latin America 2022
• 49mIntroduction to Real-Time Analytics with Apache PinotTim Berglund · GOTO Chicago 2023
• 47mReal-time Analytics for Your Users with Apache PinotFrançois Teychene · Devoxx France 2022
• 31mReal-time Analytics: Going Beyond Stream Processing With Apache PinotMark Needham · Big Data LDN 2022
• 44mUSER-FACING, REALTIME ANALYTICS USING APACHE PINOTNeha Pawar · Crunch Conference 2021
• 38mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotKarin Wolok, Rong Rong · Open AI + Data Forum @ Open Source Summit North America 2022
• 34mReal-Time Analytics: Going Beyond Stream Processing with Apache PinotMark Needham, Karin Wolok · Open Source Summit Latin America 2022: Open AI + Data Forum
• 46mOptimizing Speed and Scale of User-Facing Analytics w Kafka and PinotK Wolok, T Berglund · Voxxed Days Zürich 2022