Streaming Analytics with Apache Pulsar

on YouTube ↗32m

" summary

Apache Pulsar is a Kubernetes-native messaging and streaming platform that claims millions of messages a second throughput, uses BookKeeper and ZooKeeper for storage/metadata, and offers tiered storage to offload older data to S3. Aerospike integrates bidirectionally: an XDR connector pushes changes into Pulsar and pulsar-sync writes stream results back into Aerospike for low-latency serving. Users report massive scale (Tencent >10 billion msgs/day, Splunk billions/day) and one customer consolidates RabbitMQ instances into Pulsar, cutting ops costs by roughly 50%.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 1:28About StreamNative
3. 1:50Modern Data Needs
4. 6:10Apache Pulsar
5. 17:06Pulsar and Aerospike
6. 21:37Conclusion
7. 22:37Questions
8. 23:55Streaming vs Messaging
9. 29:20Connectivity
10. 30:45Summary

" related talks

• 46mApache Pulsar: Finally an Alternative to Kafka?Julien Jakubowski · DevDays Europe 2024
• 51mEvent Streaming and Processing with Apache PulsarMary Grygleski · Conf42 Cloud Native 2022
• 10mA tour of Apache PulsarJowanza Joseph · The Lead Developer Austin 2018
• 54mApache Pulsar Development 101Timothy J Spann · Devnexus 2023
• 50mEvent-Driven Change Data Capture using Apache PulsarMary Grygleski · Jfokus 2023
• 43mBuilding a Real-time Analytics Application with Apache Pulsar and Apache PinotMary Grygleski, Mark Needham · OSA Con 2022
• 30mFlink + Pulsar: The Path To Unified Batch and StreamingAddison Higham · Flink Forward Global Virtual 2020
• 32mBuilding a Real-time Ingestion Platform using Kafka and AerospikeMatteo Pelati · Aerospike Virtual Summit ’20