MesosCon North America 2017
2017-09-13..2017-09-15
Los Angeles, United States
| title | author | length |
|---|---|---|
| Keynote: State of the Mesos | Ben Hindman | 15m |
Tells concrete progress: twelve releases since last MesosCon with 1.0 then 1.1–1.3 and nine patch releases, plus thirteen new committers/PMC members. Ships a… | ||
| Keynote Panel Discussion: SMACK Today and Tomorrow | Ben Hindman | 28m |
Panelists state that the SMACK mix—Kafka, Spark, Mesos, Akka, Cassandra—powers real deployments for personalization, fraud detection, customer 360 and IoT… | ||
| Keynote: Welcome to Day 2 | Jörg Schad | 07m |
Morning recap emphasizes practical outcomes: a hackathon delivers UI and docs improvements and demo code destined for Mesosphere, a Kubernetes milestone gets… | ||
| Keynote Panel: Future of Cluster Management | Elizabeth K. Joseph | 27m |
Operators describe running Mesos at scale: Yelp runs it for all production and CI, Uber migrates most production in ~18 months with "big success," and Netflix… | ||
| Keynote: NSG Data Analytic Architecture Service | Todd Myers, Kevin Fitzhenry | 21m |
National Geospatial-Intelligence Agency adopts Apache Mesos and DC/OS to run large-scale geospatial processing, builds an isolated local universe (sidecar… | ||
| Keynote: Are We There Yet? | Ross Gardler | 22m |
Argues there is no clear winner in container orchestration, shows Azure Container Service deliberately supports Kubernetes, DC/OS and Mesos, and shares… | ||
| Applying Geospatial Analytics at a Massive Scale using Kafka, Spark and Elasticsearch on DC/OS | Adam Mollenkopf | 41m |
Architecture uses Kafka, Spark (streaming and batch), Elasticsearch and DC/OS to ingest and analyze at millions of events per second, rearchitecting a monolith… | ||
| State is Hard: An SDK for Building Stateful Applications | Gabriel Hartmann | 38m |
DC/OS SDK provides a framework generator on Mesos that codifies the shared 95% of stateful-service code and ships working frameworks for Kafka, Cassandra… | ||
| Deploying Kafka on DC/OS | Kaufman Ng | 41m |
Practical checklist for running Kafka on DC/OS: deploy three brokers with one broker per host using DC/OS placement constraints and pinned volumes, give… | ||
| Using Mesosphere Enterprise DC/OS to Deliver Real-Time Microservices to a Global Fleet of Ships | Eli Tsinovoi | 44m |
Royal Caribbean runs the same container platform ship and shore on Mesosphere Enterprise DC/OS, deploying Lagom microservices with Cassandra and Kafka across a… | ||
| DataStax Enterprise on DC/OS - Yes, It’s Possible; Customer Case Studies | Ravi Yadav, Kathryn Erickson | 35m |
Claims that DataStax Enterprise runs production on DC/OS, and shows the engineering to prove it: a custom framework built on the DC/OS SDK (dcos-common), five… | ||
| Building Next-Generation Audience Targeting and Analytics at NBCUniversal | Thomas Barr | 39m |
NBCUniversal builds a cloud data lake that runs Apache Mesos/DC/OS with Spark, Kafka and Cassandra, storing Parquet on S3 to avoid HDFS sprawl. It exposes data… | ||
| IP Anycast: DC/OS Networking for the Modern Datacenter | Bill Green | 35m |
New Relic experiments show IP anycast for DC/OS/Docker by advertising per-container /32 host routes from a BGP daemon on each host, using a spine‑leaf fabric… | ||
| Day 2 Operations Best Practices with Apache Mesos | Janet Yu | 30m |
Shows a working pipeline that polls the Mesos metrics API every 10 seconds from an 8‑node test cluster (7 private agents, 1 public agent), extracts… | ||
| GASP! My Container Cluster Just Went Down and I Don’t Know Why! | Kamalakannan Muralidharan, Ranga Rajagopalan | 31m |
Claim: enterprise clusters keep a north‑south central load balancer for single‑point traffic control rather than full service‑mesh east‑west. Implementation… | ||
| Container Networking for Micro-Services: An Apache Mesos and DC/OS Networking Deep Dive | Deepak Goel, Jörg Schad | 30m |
Explains how DC/OS uses Mesos + CNI to give IP-per-container over VXLAN overlay, with the master slicing a global subnet into per-agent prefixes (example… | ||
| Apache Mesos and Security: The Joy of Mesos with Calico | Diego Oliveira, Acácio Alves dos Santos | 37m |
PagSeguro replaces VLANs and slow manual ACLs with Calico BGP routing and policy-based security, giving each container one IP per container and programmable… | ||
| What Security People Want: Making DevSecOps Happen with Containers | Tsvi Korren | 46m |
Argues that containers let security shift left by treating OS and runtime as code: build an base image pipeline that scans images against policy, signs them… | ||
| Adopting Microservices in Healthcare, Breaking Apart the Monolith | Aaron Baer | 41m |
Athenahealth breaks a Perl/Oracle monolith by strangling pieces into microservices, proving an API-driven deployment that launches the same job into on‑prem… | ||
| Deployment API | Chris Mays | 32m |
HERE builds a proxy deployment API that merges three-tier YAML (global, app, env) into a validated Marathon JSON, injects required docker params and labels for… | ||
| API Gateway Pattern & Kong in a Microservices World | Marco Palladino | 42m |
Kong is an open source API gateway built on Lua + NGINX that claims 300,000 running instances per month and achieves sub-millisecond processing latency after… | ||
| Continuous Delivery for DC/OS with Spinnaker | Will Gorman | 41m |
Cerner extends Spinnaker to deploy to DC/OS, wiring the Spinnaker DC/OS provider to create versioned Marathon apps (server groups), run CI-triggered pipelines… | ||
| Apache Mesos For All Your Hybrid Cloud Needs | Imran Shaikh | 34m |
Apache Mesos For All Your Hybrid Cloud Needs - Imran Shaikh, YP
Hybrid cloud is bigger than ever. The demand is skyrocketing especially after the outage of a… | ||
| Lessons Learned: Deploying Microservices Software Product in Customer Environments | Mark Galpin | 42m |
JFrog recounts concrete changes: Artifactory migrates from pet to cattle, shipping as Artifactory 5 removes NFS and centralizes license management after… | ||
| My Application is Ready for Production... Now What? | Gastón Kleiman, Kevin Klues, Johannes Unterstein | 01h 05m |
Shows concrete steps to deploy and debug apps on Mesos/DC/OS using Marathon, Minuteman VIPs, and overlay networks; demonstrates health checks killing tasks… | ||
| Bootstrapping Secure Mesos Clusters | Vishnu Mohan | 38m |
Hands‑on lab boots a master and agent from the GitHub repo DCOs-labs/secure-mesos-workshop using Docker images and mesos 1.4 rc5, then flips flags to add TLS… | ||
| Building Your First Stateful DC/OS Service | Ben Wood | 01h 35m |
DC/OS SDK produces a runnable scheduler package: author builds a stub universe jar, uploads artifacts to S3, and installs via Cosmos; the demo launches a… | ||
| Accelerating Spark Workloads in an Apache Mesos Environment with Alluxio | Adit Madan | 31m |
Alluxio on a Mesos / DC/OS cluster frontends HDFS and S3 into a unified namespace, caches blocks in memory (demo uses Alluxio 1.5, Spark 2.x on EC2) and keeps… | ||
| Real-Time Event Processing and Handling Stateful Applications on Apache Mesos | Balajee Nagarajan, Venkatesh Sivasubramanian | 39m |
GE Digital describes running thousands of developers and ~30,000 apps on a Mesos-backed Predix platform that ingests extreme edge data (a GE jet engine ~1… | ||
| Distributed Deep Learning on Apache Mesos with GPUs and Gang Scheduling | Min Cai | 37m |
Uber runs distributed TensorFlow on Mesos using GPU isolation and nested containers to separate management and user images, adds a custom Peloton scheduler for… | ||
| Distributed Data on Distributed Infrastructure | Jörg Schad, Claudius Weinberger, Kunal Kusoorkar | 40m |
ArangoDB runs as a native multi‑model database on Mesos with a single query language, per‑collection replication factor 2 and shard placement; early… | ||
| Running a Cloud-Native SQL Database on Mesos | Ben Darnell | 37m |
CockroachDB runs on Mesos/DC/OS using the DC/OS SDK and installs with a single command to launch a three-node cluster that can be resized live (demo expands to… | ||
| Streaming Data Pipelines on Apache Mesos: Lessons Learned | Dean Wampler | 42m |
Argues that Mesos outperforms YARN for mixed streaming and microservice workloads, showing concrete reasons: Mesos two-level scheduling lets frameworks decide… | ||
| How Yelp.com Runs on Apache Mesos in AWS Spot Fleet for Fun and Profit | Kyle Anderson | 36m |
Yelp runs Mesos clusters on AWS Spot Fleet, saving about 50% compared to reserved instances by overprovisioning and accepting 120‑second terminations… | ||
| Monitoring Mesos with InfluxDB & the TICK Stack | Paul Dix, Tehmasp Chaudhri | 42m |
Complete monitoring pipeline based on the open-source TICK stack: Telegraf agents collect Mesos, Docker and ZooKeeper metrics via ~100 plugins, data lands in a… | ||
| Astronomer's Journey from Cloud Lock-in to OSS Independence | Aaron Brongersma | 24m |
Migration narrative:Astronomer replaces AWS-managed pieces with open source on Apache Mesos/DCOS, swapping API Gateway+Lambda+Kinesis for a Go API, Kafka… | ||
| Using External Persistent Volumes to Reduce Recovery Times and Achieve High Availability on DC/OS | Dinesh Israni | 40m |
Portworx on DC/OS provisions external block volumes for stateful apps so a three node Cassandra cluster boots with volumes auto-created, a replication factor 3… | ||
| Packet, Qualcomm, & Mesos: A Window into the Development of the Armv8 Ecosystem | Ed Vielmetti | 42m |
Packet provides bare‑metal access to Qualcomm Centriq 2400 servers (Armv8 64‑bit, up to 48 cores) and automates provisioning with Terraform so developers can… | ||
| Doing “DropBox” the Cloud Native Way | Jörg Schad | 31m |
Rebuilds a Dropbox-like service on DC/OS using containerized pieces: web frontend in Go, API servers, Minio object storage, Redis for metadata and MySQL for… | ||
| Practical Container Scheduling: Juggling Optimizations, Guarantees, and Trade-Offs at Netflix | Sharma Podila | 39m |
Netflix runs Mesos frameworks Titus and Mantis and builds an open‑source Fenzo scheduler to juggle bin‑packing, locality, capacity guarantees and elasticity… | ||
| Simulating Our Apache Mesos Framework for Fun and Profit and... | Wil Yegelwel | 34m |
Two Sigma builds a deterministic, faster-than-real-time simulator for Cook that uses an in-memory datastore and a mock Mesos master and driver to run… | ||
| Automated Performance Tuning with Bayesian Optimization | Joshua Cohen, Ramki Ramakrishna | 41m |
Describes a production system that uses Bayesian optimization (Spearmint) to tune JVM and container knobs via Mesos/Aurora orchestration, injecting configs and… | ||
| 8 Tips for Marathon Performance | Tomasz Janiszewski | 36m |
8 Tips for Marathon Performance - Tomasz Janiszewski, Allegro
Mesosphere Marathon is a Mesos scheduler that can handle huge production installation. In this… | ||
| OpenWhisk as an Apache Mesos Framework | Tyson Norris | 41m |
OpenWhisk runs actions in Docker but now operates its invoker as a Mesos framework by embedding a Mesos actor that talks to the Mesos scheduler HTTP API… | ||
| Fault Tolerant Frameworks - Making Use of CNI Without Docker | Aaron Wood | 35m |
A fault‑tolerant Mesos framework and a Go SDK that use the v1 streaming API and the UCR (universal containerizer) with CNI networking replaces Docker and… | ||
| Multi-Tenancy in Apache Mesos | Ben Mahler, Jay Guo | 39m |
Mesos already ships multi-role framework support (1.3) so a single Marathon can register multiple logical roles and use quota and reservations per role… | ||
| Improving Storage Support in Apache Mesos using CSI | Steven Wong, Jie Yu, James DeFelice, Chakravarthy Nelluri | 44m |
Mesos adds a pluggable storage layer so CSI plugins talk to Mesos as resource provider instances, letting Mesos discover capacity, provision and publish… | ||
| Expanding Mesos Ecosystems: Enabling Mesos on Windows | Andy Schwartzmeyer, Jeff Coffler | 34m |
Mesos runs Windows agents against existing Linux masters, shipping a working CMake build that replaces autotools, adds Java bindings, Ninja support and… | ||
| Challenges of File System Isolation | Santhosh Kumar Shanmugham | 33m |
Explains why Twitter’s Apache Aurora on Apache Mesos cluster lacks file system isolation, what enabling Docker at scale looked like, and what actually broke… | ||
| Idle Resources Oversubscription: Improving Cluster Utilization | Dmitry Zhuk | 41m |
Twitter runs a >30,000-node Mesos cluster and finds non‑production jobs hold ~10% of CPUs but exhibit 30–50% idle CPU capacity (p95 of tasks often under 10%)… | ||
| An Overview of Mesos Containerization and the Default Executor | Gilbert Song, Anand Mazumdar | 42m |
Mesos exposes a Unified Container Runtime (UCR (Unified Container Runtime)) that pulls OCI and Docker images, uses CNI and CSI plugins for networking/storage… | ||
| nothing matches | ||