Big Data Overview

on YouTube ↗05m

" summary

Definition: big data means the three V's — volume (terabytes to petabytes), velocity (need for near‑real‑time insight) and variety (structured plus unstructured). Practical path: start with a small, valuable use case, get it into production, then expand. Architecture claim: combine Hadoop batch for accuracy with a Storm speed layer for real time. Limitation: the speed layer sees only a sliding window so expect approximations or reconciliation with batch results.

AI-written summary · about

" chapters (6)

1. 0:00Intro
2. 0:20DataCrunchers
3. 0:34Big Data
4. 1:34Where to start
5. 2:23Common mistakes
6. 3:07Conclusion

" related talks

• 41mTo Big Data or Not Too BigLaura Lacarra · AdaLoversConf 2019
• 36mBig Data, Disruption And The 800 Pound Gorilla In The CornerMichael Stonebraker · Big Data LDN 2018
• 45mSolving Real & Big (Data) Problems Using HadoopEva Andreasson · GOTO Aarhus 2013
• 58mUnderstanding Big Data for Software EngineersDavid Ostrovsky · NDC Oslo 2023
• 08mHadoop and Big Data HypeJack Norris · Strata Conference New York + Hadoop World 2013
• 45mFrom Big Data to Big InformationDean Wampler · GOTO Aarhus 2013
• 47mWhat's Ahead for Big Data?Dean Wampler · Code Mesh 2013
• 51mBIG DATA STORAGE & PROCESSING: Introduction to Hadoop and Its EcosystemFilippo Natali · Incontro DevOps Italia 2018