Apache Pulsar Development 101

on YouTube ↗54m

" summary

Overview of practical streaming setup and tradeoffs using Apache Pulsar, Kafka, Flink, Spark, NiFi and Spring with live Docker demos that run on a laptop. Shows Pulsar features: built-in schema registry, tiered storage, multi-protocol support, multi-tenancy handling over a million topics, and CDC at scale (example: 25,000 tables moved in parallel). Demonstrates NiFi drag‑and‑drop flows, Spring producers/consumers, Pulsar functions and an interceptor, and a Flink SQL pipeline; all examples are implemented, deployed and shown working.

AI-written summary · about

" chapters (5)

1. 0:00Start
2. 12:55Apache Pulsar Ecosystem
3. 17:19Schema Registry
4. 19:53Pulsar - Spring - Configuration
5. 25:17APACHE ICEBERG

" related talks

• 46mApache Pulsar: Finally an Alternative to Kafka?Julien Jakubowski · DevDays Europe 2024
• 51mEvent Streaming and Processing with Apache PulsarMary Grygleski · Conf42 Cloud Native 2022
• 32mStreaming Analytics with Apache PulsarAddison Higham · Aerospike Digital Summit 2021
• 10mA tour of Apache PulsarJowanza Joseph · The Lead Developer Austin 2018
• 30mFlink + Pulsar: The Path To Unified Batch and StreamingAddison Higham · Flink Forward Global Virtual 2020
• 43mBuilding a Real-time Analytics Application with Apache Pulsar and Apache PinotMary Grygleski, Mark Needham · OSA Con 2022
• 43mHail Hydrate! From Stream to Lake Using Open SourceTimothy J Spann · Open Source Summit + Embedded Linux Conference + OSPOCon 2021
• 50mEvent-Driven Change Data Capture using Apache PulsarMary Grygleski · Jfokus 2023