Hyper Speed! When Big Data Blooms
summary
Describes how Report URI handles very high-throughput telemetry ingestion and processing—specifically receiving and processing about 65,000 JSON payloads per second from global clients—and the technologies and techniques used to manage that scale.
AI-written summary · about
chapters (20)
- 0:00Start
- 2:47XSS (Cross-Site Scripting)
- 7:04Content Security Policy
- 7:46Controlling JavaScript
- 8:52Control Everything
- 10:24Knowledge is Power
- 11:04Violation Reporting
- 12:12Scale Up
- 13:28Handling Volume
- 17:37Bloom Filters to the Rescue!
- 18:07Hash Functions
- 23:27Probabilistic Data Structure
- 23:53Setting up your Bloom Filter
- 25:12Calculating Values
- 26:23Calculating w
- 29:04Real World Examples
- 35:59Counting Bloom Filter
- 36:37Cuckoo Filter
- 37:14Count-Min Sketch
- 39:26HyperLogLog
related talks
48mHyper Speed! When Big Data Blooms
01h 00mHyper Speed: When Big Data Blooms
50mHow We Store 60,000 Events per Second
26mReimagine Real-time
56mReal Time Data Pipelines
44mPerformance Testing with a "Big Data Tool"
39mWhen Rivers Speak Analyzing Massive Water Quality Datasets
22mIt’s all about the db - a journey to accommodate 100k events per second