Keynote: Enabling AI with Cloud Native
Talkat Cassandra Summit 2023 · on Wednesday, 2023-12-13· at 09:50· Grand Ballroom BC (Concourse Exhibit Level)·
summary
Highlights hardware and orchestration work that makes generative AI run on cloud native stacks: GPU/TPU/FPGA slicing via KEPs and dynamic resource allocation, batch and massively parallel scheduling at production scale (examples include Kubernetes 1.24 job tracking and Kubernetes 1.26 100,000 concurrent pods), deployments across ~20,000-node clusters and ~100,000 jobs per minute, and projects to watch: Volcano, Kubeflow, Carada, KubeEdge and the topology KEPs such as Kep 3545.
AI-written summary · about
chapters (13)
- 0:00Introduction
- 0:28Jorge Castro Introduction
- 2:24Next Trillion Core Hours
- 3:37What does Open look like
- 4:02Kubernetes mindset
- 4:44Hardware enablement
- 6:46Application development
- 7:33Integrations
- 8:05New Primitives
- 8:25Kubernetes is already the web server
- 8:47scrambling up the stack
- 9:11multiple organizations
- 9:38building a scaffolding
related talks
10mKeynote: Enabling AI with Cloud Native
43mKeynote: Building AI in the Open: How the Cloud Native Community Shapes What Comes Next
09mKeynote: Kubernetes for GenAI: The New Operating System of the AI-First World
07mKeynote: Exploring the Frontiers of Cloud Native
15mKeynote: From Platforms to AI Factories. Has Kubernetes Solved It?
14mKeynote: Building the Infrastructure that Powers the Future of AI
14mKeynote: Key Cloud Native Technologies in its Next Decade
06mSponsored Keynote: Building Your AI Factory: Wh...