~/talk

SkyPilot: An Intercloud Broker for Sky Computing

on YouTube 17m
Talkat NSDI 2023 · 2023-04-17..04-19· [cloud-infrastructure, machine-learning]

speakers

name:Zongheng Yang
links:none on file
name:Zhanghao Wu
links:none on file
name:Michael Luo
links:none on file
name:Wei-Lin Chiang
links:none on file
name:Romil Bhardwaj
links:none on file
name:Woosuk Kwon
links:none on file
name:Siyuan Zhuang
links:none on file
name:Frank Sifei Luan
links:none on file
name:Gautam Mittal
links:none on file
name:Scott Shenker
links:none on file
name:Ion Stoica
linkedin:ionstoica

resources

video:https://youtu.be/3Edw88b1bRg
slides:none on file

summary

SkyPilot is an intercloud broker that automatically matches jobs to concrete zones and instance types across AWS, GCP, Azure and others, taking into account Intel SGX availability, TPU/Inferentia accelerators, egress cost and preemption patterns. It provisions, retries and live-migrates batch ML and bioinformatics jobs across clouds to handle spot preemptions, exploiting up to 3× on‑demand and 9× spot price variation and cutting makespan by about half in a bioinformatics workflow. Open-sourced, used by >10 organizations with ~20 contributors.

AI-written summary · about

chapters (10)

  1. 0:00Start
  2. 0:33Today's clouds create silos
  3. 1:36Sky Computing
  4. 2:48Standardization?
  5. 3:39Idea: Intercloud Broker
  6. 8:42Architecture
  7. 10:38Interface
  8. 11:34Cross-cloud ML pipeline
  9. 14:13Single-cloud workloads benefit too
  10. 14:47Real-world usage

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.