Scalable Stream Processing and Large-Scale Data Analysis
summary
Discusses scalable stream processing and analytics for large datasets, focusing on architectures and technologies to handle high-throughput, real-time data. Covers approaches for processing pipelines, fault tolerance, and scaling strategies using open-source tools and OSS-powered solutions referenced by the conference materials.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 2:52Search in streams
- 5:45Processing flaws
- 7:55Percolation with Yandex Search
- 11:24Percolation results
- 13:10Mention processing challenges
- 14:57Orleans for scalable processing
- 20:15Load control in Orleans
- 23:02Actor optimization
- 24:06Conclusion
related talks
30mScalability Challenges in Big Data Science
42mBuilding a Streaming (E-health) Data Pipeline: When and How?
37mBig Data Analytics, Machine Learning, Real Time Processing
30mSmart Streams: A Real-time framework for scoring Big and Fast Data
50mStreaming Data: Don’t Miss the Train, Don’t Wait in Vain
47mAdvances in Stream Analytics: Apache Beam and Google Cloud Dataflow deep-dive
19mDemystifying Big Data
33mAnalytics Platform at Petabyte Scale