~/talk

Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline!

Talkat Jfokus 2019 · 2019-02-04..02-06· [data-engineering]
slides:none on file

Live demo builds a working streaming pipeline that reads MySQL changes into Kafka, enriches and filters them with KSQL, and ships results to Elasticsearch/Kibana; everything runs in Docker, uses Kafka Connect for CDC, Avro + schema registry for typed messages, and shows exactly-once processing and materialized streams and tables. The demo creates a persistent KSQL stream that joins ratings with a customer table, drives real-time Slack alerts, and actually works end-to-end.

AI-written summary · about

  1. 0:00Start
  2. 11:59Stop! Demo time!
  3. 39:59The Stream-Table Duality
  4. 51:37Free Books!
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.