Deep Dive into Building Streaming Applications with Apache Pulsar

on YouTube ↗41m

" summary

Claims Apache Pulsar can replace multiple messaging systems by running a standalone Docker cluster or Kubernetes, separating compute and storage and handling messaging and event streaming in one platform. Languages and tools shown: Java, Go, Python, Apache NiFi, Pulsar Functions, Sinks/Sources, Pulsar SQL, Flink SQL, Spark SQL. Live demo ingests Raspberry Pi sensor JSON, runs a function to clean/enrich, writes to a Delta Lake sink, queries with Flink continuous SQL and pushes results to a WebSocket UI — it works. Native Kafka protocol handler and tiered S3 storage are used.

AI-written summary · about

" chapters (11)

1. 0:00Start
2. 6:02Connectivity
3. 10:52Schema Registry
4. 17:02Pulsar Functions
5. 18:42Building Tenant, Namespace, Topics
6. 20:42Install Python 3 Pulsar Client
7. 22:31Example Avro Schema Usage
8. 25:02Websockets
9. 27:52Setting Subscription Type Java
10. 28:59Producing Object Events From Java
11. 30:10Use Cases

" related talks

• 35mStreaming Data Made EasyTimothy J Spann, David Kjerrumgaard · OSA Con 2022
• 48mApache Pulsar: Event Streaming in The Cloud Native WorldMary Grygleski · GOTO Chicago 2023
• 34mEvent Streaming in the Cloud Native World with Apache PulsarMary Grygleski · Cloud Builders: Java Conf 2023
• 59mEvent Streaming and Processing Using Apache PulsarMary Grygleski · IntelliJ IDEA Conf 2022
• 55mEvent Messaging and Streaming with Apache PulsarMary Grygleski · Great International Developer Summit 2023
• 14mFast Data on-Ramp with Apache Pulsar on K8Timothy J Spann · Kubernetes Batch + HPC Day Europe 2022
• 48mEvent Streaming and Processing using Apache Pulsar and Apache Pinot.Mary Grygleski, Karin Wolok · Devoxx Ukraine 2022: Secure our Future
• 30mCreating a Data Fabric for IoTKarthik Ramasamy · Scale By The Bay 2018