Jared Casper
where else to find them
bluesky:jaredcasper.bsky.social
what they talk about
where they keep going back
no series more than once — all 1 in the filters
on a stage with
never shared a talk
who talks about the same things
one talk is not yet a subject
| title | conference | date |
|---|---|---|
| Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM | Systems @Scale Winter 2021 | 2021-12-08 |
Describes training a 530B-parameter transformer on a DGX SuperPOD with over 3,072 A100 GPUs using Megatron-LM + DeepSpeed, achieving 502 petaFLOP/s on a… | ||
| nothing matches | ||