Metamorphosis: When Kafka meets Camel

on YouTube ↗42m

" summary

A Kafka Connect connector built on Apache Camel reuses Camel’s components to let Kafka ingest and emit many protocols; the project focuses initially on eleven components and is donated to the Apache Camel ASF. Demos show JMS → Kafka routing, a live Telegram → Kafka → SQS pipeline, and S3 ingestion that requires a custom converter which is fixed live. Connectors run in distributed mode on Kubernetes via the Strimzi operator, and the demos work end-to-end.

AI-written summary · about

" chapters (20)

1. 0:00Intro
2. 0:24Agenda
3. 0:45Introduction
4. 1:27What is Camel
5. 2:02Enterprise Integration Patterns
6. 3:47Demo
7. 10:26Kafka Ecosystem
8. 11:40Kafka Connect
9. 13:25Kafka Concepts
10. 14:47Standalone Kafka
11. 15:50Distributed Kafka
12. 17:39Camel Connector
13. 18:38Component Selection
14. 19:21Project Overview
15. 20:06Camel Connector Demo
16. 25:16Kafka Connect Deployment
17. 29:18Kafka Connect Demo
18. 34:00Kafka Connect Demo AWS S3
19. 36:33Kafka Connect Fix
20. 38:48Wrapup

" related talks

• 38mTune Kafka to "speak" with (almost) everythingHugo Guerrero · DevConf.CZ 2021
• 01h 00mKafka for .NET DevelopersIan Cooper · NDC Oslo 2024
• 21mHow Apache Kafka® Generates Value In Retail With ConfluentAnna Semjen · Big Data LDN 2022
• 45mThe Necessity and Pain of Moving from IBM MQ + RH Fuse to Apache Kafka + Apache CamelAleksandr Krylov · Saint HighLoad++ 2022
• 33mKafka Microservices with Kafka plus Akka and Kafka StreamsBoris Lublinsky · Scala Days Berlin 2018
• 16mApache Kafka + MQTT = A Powerpack combination for end-to-end testingRuchi Shrikant Pakhle · AACoT 2023 Bangalore
• 32mCloud-era Integration with Camel QuarkusZineb Bendhiba · Devoxx France 2022
• 46mTame Kafka streams with ClojureAndrea Crotti · Lambda Days 2018