February 17 2022

Agenda

• Brief introduction: review January action items (see below), present agenda
• Finalize workgroup charter
• Cloud computing use cases
• Topics for the March meeting, including developing work group priorities

Notes

Finalized Charter

• Propose removing confusing language under "Communications, Agendas, Notes and Issue Briefs" section:

A standard format will be used by the co-leads to record the proceedings of all meetings

Replace with

A standard format will be used by the co-leads to document the proceedings of all meetings

Cloud computing use cases

UNC

• Slides

LADCO

• Slides

TCEQ

• Currently running a modeling system in house in the air program, and may need to move it to state IT management; motivated to explore cloud computing, interested in scalable computing
• Testing on AWS and Azure
• Tested with CAMx, WRF, GEOS-Chem, and EPS
• With AWS used parallel cluster with slurm
• Using singularity containers for WRF and GEOS-Chem, without for CAMx
• Running the c5.2xlarge instance in spot market for CAMx
• Using single day set up for CAMx, to loop through days where each model day is run as a separate job using wait to finish feature
• WRF testing done on 10 day episodes with 12 hour spin up; tested different instance types with and without hyperthreading, spot vs on-demand
• C5.24xlarge instance was best for WRF; running on 12km domain and smaller 4km domain took a few days and cost $35
• GEOS-Chem testing with and without singularity, tried different costs by instance type
• Tested EPS3 emissions processing, and used the cloud for training
• Challenges: billing and dealing with state legislative requirements to reconcile billing and AWS costs; predictability, hard to say how much a run is going to cost can't tell with billing

Next/Future Meeting Ideas

• Developing work group priorities