Building real-time serverless data applications
summary
Confluent Cloud paired with AWS Lambda runs a real pipeline: ksqlDB routes and normalizes mortgage events from three sources, Lambda handles legacy and third‑party unpacking, and Stream Lineage visualizes the flow — the demo shows it working end to end. Integration options are an event source mapping (auto‑polling, offset lag metric, custom consumer group IDs) or a Confluent sink connector (sync or async, at‑least‑once, soft max ~10 connector processes), with batching for throughput. Confluent offers cluster linking, ksqlDB, 120+ connectors and a 4‑9s SLA.
AI-written summary · about
chapters (6)
- 0:00Introduction and agenda
- 1:38The rise of data in motion
- 5:41Serverless stream processing
- 10:17Confluent platform advantages
- 22:27Integrating Lambda with Kafka
- 32:51Demonstration and closing
related talks
12mServerless Stream Processing with Confluent Cloud, Kafka and AWS Lambda
36mLeveraging Serverless architecture with Confluent Kafka
24mStreaming data analytics with Apache Flink
28mBuilding Event Streaming Applications with Serverless Kafka
34mDesigning Data Intensive Applications In Serverless Architecture
47mEvent-driven Serverless Architecture with DynamoDB
32mBuilding and scaling a log analytics platform - a serverless approach
47mMainframe & Serverless Integration