Building Streaming Data Apps with Pac-Man
summary
Demo builds a live Pac‑Man scoreboard: browser game events hit an API Gateway + Lambda (Java), write into Kafka topics, and ksqlDB transforms streams into tables, aggregates scores and loss counts, and joins them into a single scoreboard that updates in near real time. Output strategies include shipping results to Elasticsearch and Kibana for visualization. The pipeline runs on ksqlDB on Apache Kafka during the session, handles concurrent players, and produces a working live leaderboard (top high score observed 54,480).
AI-written summary · about
chapters (11)
- 0:00Start
- 2:07What Is Streaming Data
- 2:36Perishable Insights
- 4:39Source Data Layer
- 4:59Stream Storage
- 8:17Source Data
- 8:56Lambda Function
- 10:01Streaming Database
- 22:01The Source Data
- 24:35User Losses
- 34:11Etl Pipeline
related talks
49mLet’s Build a Streaming Data Pipeline!
29mApache Kafka and ksqlDB in Action : Let’s Build a Streaming Data Pipeline
57mTaming IoT Data: Making Sense of Sensors with SQL Streaming
58mRealtime Analytics Geofencing Kafka
33mThe rise and fall of the full stack database
40mReal-time Customer Engagement in Gaming Using Kafka and Flink
14mThe Streaming Plane
31mFun with Sensors