Unlock efficiencies from silicon to systems on Azure
summary
Microsoft announces Azure Cobalt100 custom compute chip now running real customer traffic (Teradata, Siemens, Elastic) with Cobalt-based VMs in preview and claims 40% performance uplift versus current Ampere servers and up to 45% in flagship workloads, while reducing power use and improving scalability. Azure also brings the MI300X VM series to GA with industry-leading HBM capacity so large language models can fit in accelerator memory, completing a silicon-to-systems AI infrastructure approach across custom and partner accelerators.
AI-written summary · about
chapters (5)
- 0:00Introducing Azure Cobalt
- 2:10Benefits of custom silicon
- 4:06Azure MI300X availability
- 5:43Systems approach to cloud
- 7:51Getting started with Cobalt
related talks
46mAMD + Azure: Outstanding performance and the latest security features
29mMicrosoft Azure: Operating at Hyper-Scale
22mAI @Scale
15mMake a Once-in-a-Generation Leap – Migrate to Azure Ampere-based VMs
48mAzure Stack HCI and Microsoft Hybrid Data Services
16mChange Your Chip Architecture and Save the World- 48mAzure Stack HCI and Microsoft Hybrid Data Services
28mHarnessing generative AI with NVIDIA AI and Microsoft Azure