Java is the “big” in BigData

on YouTube ↗45m

" summary

Java anchors the Big Data stack from Hadoop to Spark and in-memory grids, but concrete limits matter: MapReduce is slow (jobs take days on thousands of nodes—one run to compute 2×10^15 digits of pi uses 1,000 machines for 23 days), HDFS forces ~1 GB of NameNode heap per PB and wastes ~60% of its CPU on metadata, and moving data to memory yields massive speedups (memory is ~2,500× faster than SSD). Expect in‑memory grids (GridGain/Ignite), streaming (Kafka/Spark), and narrower AI to dominate.

AI-written summary · about

" chapters (5)

1. 0:00Start
2. 1:30Java and BigData
3. 36:36Even a moderate inflation is a theft!
4. 39:06BigMemory: lota Architecture
5. 44:29Is Java a part of the computing future?

" related talks

• 29mBig Data AnalysisSerhiy Masyutin · JavaDay Lviv 2015
• 43mWhy Java and the JVM Will Dominate the Future of Machine Learning, AI, and Big DataBernard Traversat · Oracle Code One 2018
• 32mJava's Ignored Potential: Supercharge Database Apps with Java In-Memory ProcessMarkus Kett · JCON EUROPE 2025
• 15mThe Future of DataDoug Cutting · Strata Conference in London 2013
• 57mBig Data: Threat or Opportunity?Shaun Connolly · PASS Business Analytics Conference 2013
• 01h 12mBig Data in Java World: Apache Spark and Scala. Arch and live codingOleg Klimenko · Java ON 2022
• 56mResistance is Futile: What You Need to Know about Big DataMichelle Ufford · PASS Business Analytics Conference 2015
• 47mSolving Real & Big (Data) Problems Using HadoopEva Andreasson · GOTO Chicago 2014