~/talk

Serverless Kubernetes Boosts AI Business

on YouTube 44m
Talkat KubeCon + CloudNativeCon China 2018 · 2018-11-13..11-15· [serverless, machine-learning]

speaker

name:Jian Huang
links:none on file

resources

video:https://youtu.be/JShIq3D0s6I
slides:none on file

summary

Kubernetes-backed Cloud Container Instance (CCI) is a serverless layer that runs AI workloads with kata containers for tenant isolation, supports NVIDIA GPUs and InfiniBand networking for distributed training, and reports being 95% API compatible with upstream Kubernetes. The platform extends the scheduler to do fine-grained GPU-aware placement, exposes GPU drivers from hosts into containers, handles model image sizes (tens of GB) via fast storage and object stores, and experiments with GPU sharing and NVidia MIG-style partitioning.

AI-written summary · about

chapters (5)

  1. 0:00Start
  2. 0:37Serverless Computing?
  3. 9:34Advantages
  4. 29:21Scheduler - Poseidon
  5. 30:45Scheduler - Benchmark of Poseidon

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.