Virtual Laboratories Vision for an Earth Sciences
summary
Proposal merges Earth System Grid Federation and Climate Data Analysis Tools into Virtual Laboratories that bring code to data on distributed storage, not by moving petabytes around. It already uses Python stacks with Conda one-line install for reproducible environments, CDMS/VCS/numpy/ma for IO and visualization, and a web processing API plus a Python client to run server-side computation. Federation nodes use three-tier quality control and DOIs for published datasets; autoscheduling of where code runs is under active development.
AI-written summary · about
chapters (19)
- 0:00Virtual lab project intro
- 1:04Project origins in earth sciences
- 3:12PCMDI climate model intercomparisons
- 5:40Atmospheric climate model evolution
- 7:05Paleoclimate model performance
- 8:48Data standardization and Earth System Grid
- 10:13Ultra-scale visualization tools
- 13:21Metadata in climate data management
- 16:30Challenges in Python tool distribution
- 17:54Python strengths for earth sciences
- 18:37Earth System Grid Federation
- 21:47Quality control in ESGF
- 22:53Limitations of large dataset downloads
- 23:37Vision for virtual laboratories
- 24:41Bringing code to distributed data
- 26:49Smart server-side computation
- 27:52Collaborative analysis with Jupyter
- 28:58Open-source integration and future expansion
- 29:19Community feedback and contributions
related talks
39mThe campus as a living lab: Collaboration with data lakes
15mTech Talk
49mMeteorology, Climate and Python: desperately trying to forget technical details
24mDigital Earth Pacific Cloud Native Geospatial Infrastructure for Earth Observation
38mOS-Climate & SIG-SRE: Benefiting from the Operate First Community Cloud
27mStardust: Digital Tooling for Earthly Science & Education
22mRunning Geospatial Workloads on AWS
25mEmpowering weather-satellite data users with FOSS: the Pytroll case