How to build next-gen AI services with NVIDIA AI on Azure Cloud
summary
NVIDIA AI Enterprise is available on the Azure Marketplace (on‑demand from $1/hr) and is demonstrated by a pose‑estimation pipeline that fine‑tunes a TAO model with COCO data, then deploys via DeepStream for real‑time inference — the demo fixes missed leg keypoints. Claims include 146× inference speedup on A100 vs CPU, 5× faster data prep and 4× cost reduction, H100 preview with 400 Gbps and NVLink 3.6 TB/s, and container stacks of ~30 NVIDIA + 400 third‑party components managed in the Azure ML registry.
AI-written summary · about
chapters (13)
- 0:00Intro
- 4:40The most powerful end-to-end platform for production Al NVIDIA AI Enterprise platform benefits
- 5:20Rapidly build Al enabled applications with an end-to-end solution Al and data science development and deployment tools
- 6:33Software delivering performance improvements
- 7:38Flexible software branch for all Al deployments Security, API stability, and peace of mind for all your Al investments
- 9:56Value of NVIDIA AI Enterprise subscription Support, security and reliability for production Al
- 10:33NVIDIA AI Enterprise on Azure Cloud On demand, private offers and bring your own license
- 11:57Azure Machine Learning platform architecture
- 13:45Azure Machine Learning optimized with NVIDIA AI Enterprise
- 15:20Complex ML models require 'Al-first' infrastructure
- 16:05NVIDIA AI Enterprise - GPU-optimized software on Azure Enterprise-ready Software | Performance Optimized | Secure
- 18:57DEMO: Body pose estimation using NVIDIA AI Enterprise on Azure ML Easily Iterate and Improve Video Inference with Your Data
- 21:43NVIDIA AI examples in Azure ML at Microsoft Build 2023
related talks
50mAccelerate development and deployment of Gen AI with NVIDIA on Azure
22mQuickly deploy NVIDIA optimized generative AI on Azure AI Studio
22mAI @Scale
58mDeep Learning in Microsoft Azure: CNTK, CaffeOnSpark and Tensorflow
31mAzure AI Innovations at Microsoft
01h 00m5 Levels of AI in Microsoft Azure
50mAzure AI, Power new possibilities for every organization
36mVideo analytics at scale: Deep Learning, Computer Vision, ML & Spark
