Docker as the Building Block for Datacenter-Scale Applications

on YouTube ↗53m

" summary

Explains how Apache Mesos becomes a datacenter kernel that runs Docker or tarball workloads with two-level scheduling, offering concrete tools: Marathon and Kubernetes run as schedulers, DCOS CLI packages services, and Mesos primitives include persistent volumes, revocable resources and dynamic reservations. Describes Twitter’s move from a Rails monolith to microservices on Mesos, Apple running Siri on Mesos, and features that work in production: master/scheduler/slave failover, vertical scaling on executors, inverse-offers for maintenance and guaranteed resource reservations.

AI-written summary · about

" chapters (29)

1. 0:00Introduction
2. 0:30an emerging trend
3. 2:43containerization
4. 4:12a reinforcing trend
5. 6:04failures
6. 6:54maintenance upgrading software (i.e., the kernel)
7. 9:13challenges
8. 9:28planning for failure
9. 11:31different software
10. 14:10Mesos is a cluster manager with a master/slave architecture
11. 14:40schedulers register with the Mesos master(s) in order to run jobs/tasks
12. 15:16service scheduler
13. 16:46configuration/package management
14. 19:35multiple schedulers
15. 22:37Mesos: datacenter kernel
16. 23:49Mesos primitives
17. 29:26a task with a command
18. 30:05a task with an executor
19. 31:14task/executor isolation
20. 33:00master failover
21. 33:33scheduler failover
22. 35:05slave failover
23. 37:28resource reservations
24. 38:03static reservations
25. 39:00reservations provide guarantees, but at the cost of utilization
26. 42:03inverse offer
27. 43:13persistent volumes
28. 45:34need a datacenter operating system
29. 46:32DCOS CLI

" related talks

• 39mHow we learned to love the Data Center Operating SystemSaulius Valatka · DevOps Pro Vilnius 2016
• 12mEdward Hsu, Mesosphere | DockerCon 2018Edward Hsu · DockerCon 2018
• 40mFrom Monolith to Docker Distributed ApplicationsCarlos Sanchez · DevOps Pro Vilnius 2016
• 22mKeynote: The Future of Apache Mesos and DC/OSYrieix Garnier · MesosCon Europe 2017
• 59mBuilding Distributed Systems with Apache MesosBen Hindman · Philly ETE 2015
• 42mMesos: The Operating System for your ClusterDavid Greenberg · Strange Loop 2014
• 01h 00mDeveloping Distributed Systems with Apache MesosYaniv Rodenski · NDC Sydney 2016
• 48mContainer: check! Aber wohin mit Persistent Data, Big Data oder Fast Data?!Johannes Unterstein · code.talks 2017