Numerical Weather Prediction (NWP) & EO data processing and computational workloads in the Cloud
summary
ECMWF builds a community European Weather Cloud using OpenStack (Rocky → Usuri) and Ceph Nautilus with 23 monitors, hosting a 300 PB archive that grows ~250 TB/day and serving 35 member states. The platform colocates compute with data, exposes vGPU profiles (NVIDIA vGPUs) for ML, and integrates with HPC and Copernicus feeds. Migration between OpenStack clouds uses Ceph volume clones to cut downtime to minutes, and the cloud is moving to a larger Bologna HPC deployment later this year.
AI-written summary · about
chapters (10)
- 0:00Introduction to ECMWF
- 3:55ECMWF HPC and cloud infrastructure
- 9:19OpenStack deployment journey
- 12:49Ceph storage cluster setup
- 14:58GPU workloads and virtualization
- 16:42Monitoring and user support
- 18:49Machine learning in meteorology
- 20:16European Weather Cloud use cases
- 23:07Future of the community cloud
- 25:15Q&A session