Practical Pipelines: Houseplant Soil Alerting System with ksqlDB
summary
A home system wires I2C capacitive moisture sensors into a Raspberry Pi and streams Avro-encoded readings to Confluent Cloud Kafka, enriches readings with plant metadata, and uses ksqlDB to perform a stream-to-table join and a six‑hour tumbling window aggregate that only emits when it sees 120 low readings (sensors every 30s ≈ one hour of low samples) then sends alerts via a Telegram HTTP Sink connector; the pipeline runs end‑to‑end and delivers at‑most‑one phone alert per six hours.
AI-written summary · about
chapters (17)
- 0:00Houseplant soil alerting intro
- 2:36Why custom plant monitoring
- 4:45Apache Kafka and event streaming
- 8:59Kafka as event platform
- 16:42Setting up Kafka cluster
- 18:27Raspberry Pi hardware system
- 20:12Sensor data schemas
- 21:37Kafka producer API
- 24:26Adding plant metadata
- 27:55Telegram plant metadata
- 31:46Event-driven sensor mappings
- 35:17ksqlDB plant alerts
- 41:57Joining sensor and plant data
- 44:47Low moisture alerts
- 49:45Telegram alerts via Kafka Connect
- 51:52Key takeaways
- 53:16Q&A
related talks
01h 05mPractical Pipelines: A Houseplant Soil Alerting System with ksqlDB
52mPractical Pipelines: A Houseplant Alerting System with ksqlDB
31mPractical Pipelines: A Houseplant Alerting System with ksqlDB.
45mPractical Cloud Pipelines
20mSet your data streams in motion in the ocean!
31mEnd-to-end Flink SQL with Schema Registry, Kafka & Kudu
47mBuilding a Telegram bot with Apache Kafka and ksqlDB
53mApache Kafka and KSQL in Action : Lets Build a Streaming Data Pipeline!