Strike gold (and avoid drowning) with streaming algorithms
summary
Covers streaming algorithms as tools for handling large-scale data like message streams and big-data queries, explains what they are and how they work, and gives a small catalog of concrete algorithms. Describes original uses of streaming algorithms in the Glassbox project, including solutions that would otherwise be impossible, and outlines the practical difficulties and surprises encountered.
AI-written summary · about
chapters (13)
- 0:00Intro
- 1:40What is a streaming algorithm?
- 2:43Examples: Average
- 3:25Another example
- 7:21The general idea
- 9:49Bias Corrections
- 11:23The Glassbox scenario
- 12:27Average Page Load Time
- 17:54Unique User Count
- 22:42Technical problems
- 23:51Technical solution
- 24:59Additional useful streaming algorithms
- 26:29Recommendations
related talks
23mStream Algorithms for Big Data Processing Tasks
50mStreaming Data: Don’t Miss the Train, Don’t Wait in Vain
47mOne streaming to rule them all: Streaming as the foundation of an analytics ecosystem
38mThe story of building a real-time streaming analytics system
20mStreaming Architectures
32mBig Data Processing : Where do we go next ?
41mStreaming: an Alternative to CRUD & Batch Processing
42mPrinciples and Patterns for Streaming Data Analysis