Operational ACCESS-G/R/C/TC data on raijin

Operational ACCESS-G/R/C/TC data in

ngamai:/g/sc/opdata/access_data/access_X/samvX/archive/samvX (X=g/r/tc)

ngamai:/g/sc/opdata/access_data/access_c/CYY11/running/um-output/datam (YY=AD/BN/DN/PH/SY/VT)

ngamai:/g/sc/opdata/access_postproc/pp_ACCESS-X_expver_yyyymmddhh (X=G/R/TC/AD/BN/DN/PH/SY/VT)

and SAM are now regularly copied over to raijin as follows

1. model output pX files (X=a..g)

are being converted to grib and stored on raijin at

raijin:/g/data/rr4/opendap/access-X/1/yyymmdd/hhmn (X=g/r/tc/ad/bn/dn/ph/sy/vt)

under 4v/ an/ fc/ structure to facilitate MARS/OpenDAP interface.

These grib files can be converted to NetCDF format by "g2nc", or retrieved in a mars request, with

export GRB_ROOT=/g/data/rr4/opendap

and normal MARS retrieval requests.

2. pressure level fields as calculated by BNOC

are copied directly from /g/sc/opdata/access_postproc in grib format and stored at

raijin:/g/data/rr4/opendap/access-X/1/yyymmdd/hhmn (X=g/r/tc/ad/bn/dn/ph/sy/vt)

as pcNNN.grb under an/ and fc/

Retrieval via mars as per above (with levtype = pl)

3. archived data on sam

are first recovered and then rsync'ed to raijin at

raijin:/g/data/rr4/samnmc/access-X/yyyy/mm

in the same directory structure as on sam, ie.

sam:/samnmc_glob/access-g/yyyy/mm

an_smc.yyyymmddhh00

analysis-increments_yyyymmddhh00

bgerr.yyyymmddhh

bk.ppsmc.yyyymmddhh00

bufryyyymmddhh.tar.gz

cx.yyyymmddhh.tar.gz

cx.background.yyyymmddhh00

ECMAyyyymmddhh.tar.gz

environment.yyyymmddhh.tar.gz

frame_access_r.yyyymmddhh.tar.gz

iau-start-dump.yyyymmddhh00

iau0-dump.yyyymmddhh00

satradbiases.yyyymmddhh.tar.gz

screen-var.yyyymmddhh.tar.gz

varobs.yyyymmddhh.tar.gz

web.yyyymmddyy.tar.gz

ls_fields_yyyymmddhh/ qwxbgza_ca0NN.yyyymmddhh (nn=06..12)

pi_yyyymmddhh/

qwxbgza_piNNN_yyyymmddhh_utc_fc.um

sam:/samnmc_reg/access-r/yyyy/mm

an_smc.auslam.yyyymmddhh

analysis-increments_yyyymmddhh00

bufryyyymmddhh.tar.gz

cx.yyyymmddhh.tar.gz

ECMAyyyymmddhh.tar.gz

environment.yyyymmddhh.tar.gz

frame_seqld.yyyymmddhh.tar.gz

frame_sydney.yyyymmddhh.tar.gz

frame_victas.yyyymmddhh.tar.gz

frame_adelaide.yyyymmddhh.tar.gz

frame_darwin.yyyymmddhh.tar.gz

frame_perth.yyyymmddhh.tar.gz

iau0-dump.yyyymmddhh00

satradbiases.yyyymmddhh.tar.gz

varobs.yyyymmddhh.tar.gz

web.yyyymmddhh.tar.gz

input_yyyymmddhh/ an_smc.yyyymmddhh

lbc_yyyymmddhh_alabc_aus

qwqg12.yyyymmddhh.bgerr

pi_yyyymmddhh/ qwxbeta_piNNN_yyyymmddhh_utc_fc.um

sam:/samnmc/access_c/YY/yyyy/mm (YY=adelaide/darwin/perth/seqld/sydney/victas) astart.yyyymmddhh

lbc_yyyymmddhh_alabc_aus

um_environment.yyyymmddhh.tar.gz

3. data not yet copied over to raijin

as they are not archived in sam:

obs-monitoring/

ops-listings/

access-g analysis-fields/ ice.glb.recon, sst.glb.recon

access-r analysis-fields/ analysis-pf

cycle_dumps/ls-fields-dir/ qwxbeta_ca0NN

---

cron jobs

are running roughly an hour after the model finished,

03 01 * * * /g/sc/home/ttl/cron/nci_data.sh access-g 18 2>&1 > /dev/null

40 03 * * * /g/sc/home/ttl/cron/nci_c.sh 00 2>&1 > /dev/null

00 04 * * * /g/sc/home/ttl/cron/nci_data.sh access-r 00 2>&1 > /dev/null

03 07 * * * /g/sc/home/ttl/cron/nci_data.sh access-g 00 2>&1 > /dev/null

40 09 * * * /g/sc/home/ttl/cron/nci_c.sh 06 2>&1 > /dev/null

00 10 * * * /g/sc/home/ttl/cron/nci_data.sh access-r 06 2>&1 > /dev/null

03 13 * * * /g/sc/home/ttl/cron/nci_data.sh access-g 06 2>&1 > /dev/null

40 15 * * * /g/sc/home/ttl/cron/nci_c.sh 12 2>&1 > /dev/null

00 16 * * * /g/sc/home/ttl/cron/nci_data.sh access-r 12 2>&1 > /dev/null

03 19 * * * /g/sc/home/ttl/cron/nci_data.sh access-g 12 2>&1 > /dev/null

40 21 * * * /g/sc/home/ttl/cron/nci_c.sh 18 2>&1 > /dev/null

00 22 * * * /g/sc/home/ttl/cron/nci_data.sh access-r 18 2>&1 > /dev/null

where nci_data.sh is the driving script to loop over the model output pX (X=a..g) files in parallel, it calls the main script nci_send_data.sh to convert/send ACCESS-G/R data to raijin

---

Bureau archives of ACCESS-G2 start files

More information regarding the location of ACCESS-G2 start-files archived on Bureau of Meteorology filesystems is available here: G2_data_at_BoM.