Storm, a Distributed Real-time Data Processing System

on YouTube ↗37m

" summary

Introduces Apache Storm as a real-time data processing alternative to batch-oriented Hadoop, explaining streams, topologies, spouts, and bolts and how Storm provides scalability and fault tolerance. Shows real-world use cases (like Twitter-style feed analysis and trend detection) and demonstrates architecture and data delivery/processing with code examples in Java, Python, and PHP.

AI-written summary · about

" chapters (10)

1. 0:00Stream processing intro
2. 4:40Storm's origin and purpose
3. 7:49Storm concepts and architecture
4. 12:24Bolt processing and topologies
5. 18:06Python example
6. 23:07Scaling topologies
7. 27:46Performance and testing
8. 31:20Storm beyond Twitter
9. 33:51Enterprise use cases
10. 35:15Summary and future

" related talks

• 42m"Distributed stream processing in Ruby"Walerian Sobczak · RubyC 2019
• 40mBrace yourself! Storm is coming!Łukasz Gebel, Michał Koziorowski · JDD 2017
• 36mReal Time Big Data Analytics with Kafka, Storm, HBase #bbuzzAmeya Kanitkar · Berlin Buzzwords 2015
• 20mLow latency scalable web crawling on Apache Storm #bbuzzJulien Nioche · Berlin Buzzwords 2015
• 41mThe Engineer's Guide to StreamingIlya Ganelin · Data By the Bay 2016
• 44mReal-time Data Processing with Apache Spark Structured StreamingEiti Kimura · QCon São Paulo 2019
• 39mReal Time Datamining and Aggregation at ScaleTed Dunning · Berlin Buzzwords 2012
• 35mReal Time Marketing with Kafka, Storm, Cassandra & Spark #bbuzzVolker Janz · Berlin Buzzwords 2016