Example are assuming that your current work directory is ESGF_download/bin

These scripts will create a text file with one command per line to be run by either a cluster or parallel.

./get_dl_scripts_v2.sh ../dl_scripts/

The result is a unique file named like runfile_<date>_<UUID>_<hostname>.run e.g. runfile_20190919131011_59fe00fb-1d83-48b2-a815-3cd73dbb845f_login-nird-1.run

The experiment names are read from the file ./experiments_all.txt , the variable names read from the file ./vars_all.txt.

./get_dl_scripts_v2.sh ../dl_scripts/ piControl

The result is a unique file named like runfile_<date>_UUID_<hostname>.run e.g. runfile_20190919131011_59fe00fb-1d83-48b2-a815-3cd73dbb845f_login-nird-1.run

The variable names read from the file ./vars.txt.

You can e.g. use GNU parallel to run the contents of the file:

/usr/bin/parallel -v -j ${SlotsToUse} -a "${runfile}"