Running FKESSLER on Casper - NCAR/StormSPEED GitHub Wiki
Here are the detailed steps to create, configure, build and run the FKESSLER case on Casper's HTC CPU node (62 CPU cores per node), using the intel compiler.
Clone the StormSPEED github repo on Casper
cd /glade/derecho/scratch/$USER
git clone [email protected]:NCAR/StormSPEED.git
cd StormSPEED
Check out the stormspeed development branch
git checkout stormspeed
Check out the individual components
./bin/git-fleximod update
Create a case
PLEASE: remember to replace /path_to_your_test_dir
with your actual path on Casper.
cd cime/scripts
./create_newcase --case /path_to_your_test_dir --mach casper --compset FKESSLER --res ne30_ne30_mg17 --compiler intel --run-unsupported
Configure the case with customized options
General comments
- remember to replace
YOUR_PROJECT_ACCOUNT
with your actual project allocation on Casper. - change
NTASKS=62
toNTASKS=124
if you want to use two new HTC compute nodes on Casper. - change
CAM_TARGET
tocam
,theta-l
ortheta-l_kokkos
to test different dycores.
For 2025 DCMIP workshop:
- the line
./xmlchange JOB_QUEUE='workshop'
is needed to access the reserved computational resources. - the line
./xmlchange CIME_OUTPUT_ROOT=/glade/work/$user
is needed since Luster filesystem is overheating and we can not access the scratch space.
cd /path_to_your_test_dir
./xmlchange CIME_OUTPUT_ROOT=/glade/work/$user
./xmlchange NTASKS=62
./xmlchange CAM_TARGET=theta-l
./xmlchange STOP_OPTION=ndays,STOP_N=12,RESUBMIT=0
./xmlchange PROJECT=YOUR_PROJECT_ACCOUNT
./xmlchange JOB_WALLCLOCK_TIME=00:30:00
./xmlchange DOUT_S='FALSE'
./xmlchange JOB_QUEUE='workshop'
./case.setup
Make user changes to the namelists
Example: Change CAM namelist to interpolate history output to a lat/lon format to make visualization easier
cat >> user_nl_cam << EOF
interpolate_output = .true.
interpolate_nlat = 192
interpolate_nlon = 288
EOF
Build the case
./case.build
Run the case
./case.submit