Develop, Build & Deploy Lightweight AI Services with WebAssembly
Talkat KubeCon + CloudNativeCon + Open Source Summit China 2023 · on Wednesday, 2023-09-27· at 11:00· 2层 会议室 1 | 2F Room 1·
summary
Explains using WebAssembly (Wasm) as a lightweight runtime for AI inference to replace bulky Python-in-container workflows. Covers writing inference functions in Rust, JavaScript, or Python (including PyTorch and TensorFlow examples), extending LLMs like ChatGPT in Rust, and deploying those Wasm-based inference functions with Kubernetes and similar tools.
AI-written summary · about
related talks
41mWebAssembly Based AI as a Service
40mWebAssembly for AI Infra : A Lightweight, Fast, and Secure Alternative Approach
33mWebAssembly based AI as a Service with Kubernetes
37mGetting Started with AI and WebAssembly
32mWebAssembly Based AI as a Service on the Edge with Kubernetes
31mRunning AI workloads with WASM - is it production ready? [Panel]
25mLeveraging Wasm for Portable AI Inference Across GPUs, CPUs, OS & Cloud-Nativ...
37mAI/ML at the Extreme Edge with WebAssembly: A Path Forward