How to Handle 1 Billion Emails?
summary
An email service handling ~2 billion messages/month (≈60M/day) with peaks of ~100k concurrent messages and ~85% spam from botnets describes a defensive stack: a distributed deduplication/counting system that fingerprints normalized word patterns, DKIM-like signing, and per-country traffic heuristics. Storage is a custom three-replica cluster on XFS nodes optimized for many small objects (median message ~8 KB) and designed to tolerate drive and node failures.
AI-written summary · about
chapters (10)
- 0:00Wprowadzenie i skala wyzwania
- 3:22Źródła i charakter spamu
- 8:17Metody walki ze spamem
- 12:05Botnety i zagrożenia sieciowe
- 15:17Ewolucja systemów pocztowych
- 19:35Architektura przechowywania danych
- 23:12Rozwiązania redundancji i wydajności
- 25:43Ograniczenia i testy skrzynek
- 26:04Dostęp do poczty i webmail
- 27:30Pytania i podsumowanie
related talks
53mAdventures at HyperScale!
51mNetrunner's Guide to AWS SES: Hacking Communication Barriers
52mHit 350 Milliseconds: The Evolution of Mail.ru Mail Anti-Spam Architecture
56mEmail vs Capitalism, or, Why We Can't Have Nice Things
44mModern Email Security
12mWelcome to Spam Fighting @Scale
31mHow to Write Terrible Emails Well?
21mFortify the Fort: Think outside the security