PyTorch at Microsoft
summary
PyTorch becomes the production DL stack for training at scale with native Windows support, ONNX for runtime acceleration, and model/data parallelism to handle huge nets. Teams train a 1.2 billion parameter model (Yule) that covers 100+ languages with weaker results on low‑resource ones, then compress with knowledge distillation and ONNX to deploy across CPUs, GPUs and FPGAs. A deployed pipeline hits about 1,000,000 inferences per second on FPGA for a 30–40M model and powers Bing, Outlook, Powerpoint Designer.
AI-written summary · about
chapters (6)
related talks
08mInterview Speaker
12mPyTorch on Windows
06mKeynote: PyTorch Lightning: Powering the GenAI Revolution from Research to the...
38mBring AI experiences to all your Windows Devices
01h 05mDeep Learning with PyTorch
58mDeep Learning in Microsoft Azure: CNTK, CaffeOnSpark and Tensorflow
47mGet to Know PyTorch - A Cutting Edge Open Source AI Framework for Deep Learning
54mKeynote: PyTorch 2.1 Technical Deep Dive
