FLiP Into Pulsar Apps

on YouTube ↗46m

" summary

Claims that Apache Pulsar unifies messaging and streaming with tiered storage and compute/storage separation, supports mqtt and rabbitmq protocols, and has a built‑in schema registry. Uses Flink SQL, Spark Structured Streaming, NiFi, Pinot and Pulsar functions for processing. Demonstrates a Raspberry Pi sensor and real‑time plane‑tracking pipeline that writes to topics, streams into Pinot and shows live charts with Superset — all running on one laptop and working end‑to‑end; community counts ~500 contributors.

AI-written summary · about

" chapters (17)

1. 0:00Apache Pulsar apps intro
2. 1:19What is Apache Pulsar
3. 3:06Pulsar apps with Flink Spark Pinot
4. 10:09Pulsar message schemas and keys
5. 12:21Subscription modes in Pulsar
6. 15:12Messaging vs streaming in Pulsar
7. 18:41Pulsar 2.11 key-value maps
8. 21:07Pulsar schema registry formats
9. 22:53Pulsar sources sinks protocols
10. 25:23Pulsar Functions processing
11. 28:14NiFi in Pulsar ecosystem
12. 30:23Spark to Apache Pulsar
13. 32:27Demo: sensor data to Pinot
14. 38:34Plane tracking with Pulsar websockets
15. 41:03End-to-end streaming apps
16. 42:48Pulsar learning resources
17. 44:33Q&A

" related talks

• 14mFast Data on-Ramp with Apache Pulsar on K8Timothy J Spann · Kubernetes Batch + HPC Day Europe 2022
• 53mEvent Messaging and Streaming with Apache PulsarMary Grygleski · Build Stuff 2022
• 51mEvent Streaming and Processing with Apache PulsarMary Grygleski · Conf42 Cloud Native 2022
• 46mScalable messaging and streaming with Apache PulsarJulien Jakubowski · Voxxed Days Luxembourg 2023
• 36mPulsar Functions Deep DiveDavid Kjerrumgaard · Data Con LA 2020
• 42mStream Processing with Apache FlinkTugdual Grall · DevFest Toulouse 2017
• 58mReal-Time ML Applications at Scale with Flink and Beam on Kubernetes and GCPChethan U · Flink Forward Global Virtual 2020
• 20mFlink powers Houzz near-realtime pipeline & Kubernetes logging observabilityMenglei Sun · Flink Forward Global Virtual 2020