Interoperable Hardware Acceleration for Serverless

on YouTube ↗34m

" summary

vxl is a framework that decouples function calls from hardware implementations so a single binary runs on Jetson Nano/Xavier, Intel NCS, Nvidia T4 and custom NPUs without recompilation; plugins map a static image-classify API to vendor-shipped shared objects, and vm guests call accelerators via virtio/vsock or API remoting. Integrated with Firecracker and Kata/OpenFaaS, measured end-to-end overhead is typically <5%, and the project is open source with C/Rust/Python bindings.

AI-written summary · about

" chapters (4)

1. 0:00Start
2. 0:13Overview
3. 1:07Serverless Computing
4. 3:19accelerator device access for VMS

" related talks

• 39mDelivering Serverless Experience on Kubernetes: Beyond Web ApplicationsAlex Glikson · KubeCon + CloudNativeCon Europe 2019
• 20mFirecracker: Lightweight Virtualization for Serverless ApplicationsAndreea Florescu, Marc Brooker, Phil Piwonka, Alexandru Agache, Alexandra Iordache, Anthony Liguori, Rolf Neugebauer, Diana-Maria Popa · NSDI 2020
• 15mSabre: Hardware-Accelerated Snapshot Compression for Serverless MicroVMsAndy Anderson, Zhiru Zhang, Nikita Lazarev, Christina Delimitrou, Varun Gohil, James Tsai, Bhushan Chitlur · 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24)
• 24mLightweight VMs for serverless and containersSergio Lopez Pascual · DevConf.CZ 2020
• 31mBirds of a Feather: Do You Really Need on Premises Serverless ?Igor Khapov · KubeCon + CloudNativeCon Europe 2019
• 34mKubeFlow’s Serverless Component: 10x Faster, a 1/10 of the EffortOrit Nissan-Messing · KubeCon + CloudNativeCon North America 2019
• 46mMonolith to Serverless - Can Modern Cloud-Native Java Runtimes Do It AllEmily Jiang · JCON Europe 2023
• 35mMoonshot Spark: serverless with GraalVMRose Toomey · Scale By The Bay 2019