Apache Pulsar 101: architecture, concepts & benchmarks

on YouTube ↗51m

" summary

Apache Pulsar runs brokers that are stateless brokers and pushes durable data into Apache BookKeeper and ZooKeeper, letting clusters resize without moving data; topics partition into small segments so a single cluster can host millions of topics. It provides server-side deduplication (enabling exactly‑once semantics), compacted topics, tiered storage to object stores, Presto SQL over topics, Pulsar Functions, and Java/Go/WebSocket clients, and is used in production at scale (thousands+ msgs/sec).

AI-written summary · about

" chapters (4)

1. 0:00Start
2. 13:13Protocols
3. 21:24Schema registry
4. 32:23Multi tenancy

" related talks

• 50mApache Pulsar 101: architecture and featuresSteven Le Roux, Alexandre Duval · Devoxx France 2021
• 45mScalable distributed messaging&streaming with Apache PulsarJulien Jakubowski · Berlin Buzzwords 2023
• 45mApache Pulsar: Finally an Alternative to Kafka?Julien Jakubowski · Devoxx France 2024
• 59mEvent Streaming and Processing Using Apache PulsarMary Grygleski · IntelliJ IDEA Conf 2022
• 53mEvent Messaging and Streaming with Apache PulsarMary Grygleski · Build Stuff 2022
• 34mEvent Streaming in the Cloud Native World with Apache PulsarMary Grygleski · Cloud Builders: Java Conf 2023
• 48mApache Pulsar: Event Streaming in The Cloud Native WorldMary Grygleski · GOTO Chicago 2023
• 28mBuild your next-generation stream platform based on Apache PulsarNeng Lu · Flink Forward Virtual 2020