Developing Distributed Systems with Apache Mesos

on YouTube ↗01h 00m

" summary

Shows a working Mesos framework (Scala JVM scheduler + custom executor) that actually downloads files across a cluster using resource offers and the built‑in task executor; demos run on a single‑node Vagrant Mesos with a Python HTTP server and wget, with logs visible in per‑task sandboxes. Explains cgroups/namespaces and Docker support, Zookeeper master election, framework messages (unreliable), and resource granularity down to 0.1 CPU (three decimal places).

AI-written summary · about

" chapters (16)

1. 0:00Introduction
2. 0:24Why build distributed applications
3. 1:25Distributed systems as herding cats
4. 2:11What we need to deal with
5. 4:33What is Mesos
6. 7:25What is the problem
7. 9:43Borg and Omega
8. 10:46Frameworks
9. 11:48Components
10. 12:24Scheduler
11. 17:07Scala Scheduler
12. 25:08Resource Offers
13. 44:54Building Executors
14. 45:56Mesos Ecosystem
15. 48:06DCOS
16. 54:52Demos

" related talks

• 59mBuilding Distributed Systems with Apache MesosBen Hindman · Philly ETE 2015
• 53mDocker as the Building Block for Datacenter-Scale ApplicationsBen Hindman · GOTO Amsterdam 2015
• 57mA Distributed and Fault-Tolerant Application with Apache Mesos & Apache AuroraFlorian Pfeiffer · FrOSCon 2015
• 42mMesos: The Operating System for your ClusterDavid Greenberg · Strange Loop 2014
• 53mHow We Built a Highly Scalable Machine Learning Platform Using Apache MesosDaniel Sârbe · MesosCon Europe 2017
• 45mMesos, Then and NowBen Hindman, Ian Downes · Scale By the Bay 2017
• 41mApache Kafka + Apache Mesos = Highly Scalable Streaming MicroservicesKai Waehner · MesosCon Europe 2017
• 22mKeynote: The Future of Apache Mesos and DC/OSYrieix Garnier · MesosCon Europe 2017