Event Streaming and Processing Using Apache Pulsar

on YouTube ↗59m

" summary

Apache Pulsar is presented as a cloud‑native event streaming system that separates compute and storage by using BookKeeper for append‑only durable logs and ZooKeeper for metadata; brokers are stateless. It supports Java, Python and Go clients, schema formats (Avro/JSON/Protobuf), multi‑tenancy, native geo‑replication and tiered storage, and subscription modes (exclusive, failover, shared, key‑shared) to control ordering. Lightweight stream transforms run as Pulsar Functions serverless units and connectors use Pulsar IO; GitHub activity and committers are growing since Yahoo open‑sourced it.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 3:59Event streaming basics
3. 11:06Complex event processing
4. 22:25Event-driven architecture
5. 25:55Why event streaming matters
6. 31:33Pulsar architecture
7. 39:59Pulsar scalability
8. 46:19Multi-tenancy in Pulsar
9. 49:08Pulsar developer features
10. 54:47Next steps

" related talks

• 34mEvent Streaming in the Cloud Native World with Apache PulsarMary Grygleski · Cloud Builders: Java Conf 2023
• 55mEvent Messaging and Streaming with Apache PulsarMary Grygleski · Great International Developer Summit 2023
• 48mApache Pulsar: Event Streaming in The Cloud Native WorldMary Grygleski · GOTO Chicago 2023
• 48mEvent Streaming and Processing using Apache Pulsar and Apache Pinot.Mary Grygleski, Karin Wolok · Devoxx Ukraine 2022: Secure our Future
• 35mStreaming Data Made EasyTimothy J Spann, David Kjerrumgaard · OSA Con 2022
• 51mApache Pulsar 101: architecture, concepts & benchmarksQuentin Adam, Steven Le Roux · Devoxx Belgium 2019
• 45mApache Pulsar: Finally an Alternative to Kafka?Julien Jakubowski · Devoxx France 2024
• 41mDeep Dive into Building Streaming Applications with Apache PulsarTimothy J Spann · CloudOpen @ Open Source Summit Europe 2022