Small intro to Big Data
summary
Introduces core Big Data challenges and what “big” means, then presents popular open-source tools such as Pig, Hive, Flink, Kafka and Zeppelin. Gives an entry-level overview of those technologies, their roles and application areas, and suggests directions for further exploration.
AI-written summary · about
chapters (21)
- 0:00Intro
- 0:39Outline
- 1:04What is Big Data?
- 1:52How big is Big?
- 3:23ThoughtWorks: Big Data envy
- 4:15CAP theorem
- 5:42Relational scaling
- 6:58You don't always need ACID
- 7:46BASE might be enough
- 11:38Batch Processing
- 12:55Apache Hadoop
- 17:05Apache Flink
- 18:27Stream processing
- 22:24Twitter Heron • Apache Spark Streaming
- 23:51Resource management
- 26:27Analysis
- 28:11Machine Learning
- 30:27Notebooks
- 31:19Hadoop-related
- 32:54Awesome Big Data
- 33:25Conclusions
related talks
49mAnti-Introduction to Big Data (StudentDay)
19mDemystifying Big Data
56mResistance is Futile: What You Need to Know about Big Data
29mBig Data Analysis
46mA Brief History of Big Data
47mSolving Real & Big (Data) Problems Using Hadoop
57mBig Data: Threat or Opportunity?
01h 35mDeep Dive into the Big Data Landscape