Opher Dubrovsky
where else to find them
no profile links on file
what they talk about
where they keep going back
- Berlin Buzzwords2 editions2021–2022
on a stage with
who talks about the same things
nobody close enough yet
| title | conference | date |
|---|---|---|
| Scaling your Kafka pipeline can be a pain - but it doesn’t have to be | Berlin Buzzwords 2022 | 2022-06-12 |
A multi‑petabyte Kafka pipeline (25B events/day ≈300k eps, 5M eps peak, 60 brokers, 9k partitions) moves from continuous microbatch Spark readers to hourly… | ||
| Scaling your Kafka streaming pipeline.... | Scale By the Bay 2021 | 2021-10-28 |
Nielsen Marketing Cloud runs a multi-petabyte Kafka pipeline that ingests ~25 billion events/day (≈300k/sec, peaks to 5M/sec, ~200 TB/day) across 60 brokers… | ||
| Scale By the Bay 2021 intro video by Opher Dubrovsky | Scale By the Bay 2021 | 2021-10-28 |
Concrete cases of Kafka consumer failures under rapid traffic shifts and during broker recovery, with measured numbers from a pipeline handling 250 Billion… | ||
| Should you read Kafka as a stream or in batch? Should you even care? | Berlin Buzzwords 2021 | 2021-06-15 |
A multi‑petabyte Kafka consumer is reworked from micro‑batches to hourly batch jobs using Spark on EMR, Airflow for scheduling, Kafka timestamp→offset reads… | ||
| nothing matches | ||