Greyhound - Powerful Pure Functional Kafka library

on YouTube ↗43m

" summary

Greyhound is a pure‑functional Kafka SDK rewritten on ZIO and released by Wix with concrete guarantees: used by more than 1000 event‑driven microservices, default parallelism of 8 via ZIO fibers and queues, and composable record handlers that auto‑commit offsets only after successful handling. Implementation details include replacing a non‑heap‑safe recursive poll with ZIO doWhile to fix a memory leak, a resilient producer that buffers to H2 on disk for rare broker outages, and built‑in nonblocking and blocking retry topologies.

AI-written summary · about

" chapters (9)

1. 0:00Introduction
2. 2:50Kafka Explained
3. 7:10Kafka Consumer
4. 10:47Kafka Record Handler
5. 15:10Event Loop
6. 26:03Nonblocking retry
7. 32:24Producer errors
8. 35:26Greyhound Consumer
9. 36:41Greyhound Features

" related talks

• 29mGreyhound - Powerful Pure Functional Kafka libraryNatan Silnitsky · Scala Love in the City 2021
• 35mPolyglot, Fault-Tolerant Event-Driven Programming with Kafka....Natan Silnitsky · Devoxx Ukraine 2020
• 52m10 LESSONS LEARNED FROM USING KAFKA IN 1000 SCALA MICROSERVICESNatan Silnitsky · Scalar 2020
• 30m8 Lessons Learned from using Kafka with 1000 microservicesNatan Silnitsky · Scale By the Bay 2020
• 37mKafka Based Global Data Mesh at WixNatan Silnitsky · DevDays Europe 2022
• 54mLessons learned from working with 2000 event-driven microservicesNatan Silnitsky · GeeCON 2023
• 46mLessons Learned From Working with 2000 Event-Driven MicroservicesNatan Silnitsky · Build Stuff 2022
• 01h 00mKafka for .NET DevelopersIan Cooper · NDC Oslo 2024