access_nwp_suite_input_data_InventoryOthers - ACCESS-NRI/accessdev-Trac-archive GitHub Wiki

NAS

200G/24 hours

Total: ~90T

Note. There is a possibility of NAS running for a fixed trial period. However, currently NAS trial runs near-real-time using scratch/.

City Ensemble Suite

External Inputs (per domain per cycle)

  • C3 Analysis (start dump from C3): ~6.8 Gb

  • GE3 Frames: ~2.5 Gb

  • GE3 Subareas: ~475 Mb

  • Total: ~9.7 Gb

  • For a one month trial, for one domain this is ~ 1.2 Tb.

  • For CE3 science trials, we ran 2 months per domain: ~17 Tb (7 domains, 2 months per domain).

Suite Outputs (from trials - that is, on /scratch/)

  • When converted to netCDF, a one month trial for one domain is ~28 Tb.

Common Data

  • CE3 suite uses the same UM as C3 and along with using similar control data.
  • CE3 has it's own ancillary files but are captured in the City Suite section above.

Strategy for reducing holdings

  • To reduce the amount of data required for CE3, the following could be adopted:
  • Keep the started dumps from C3 for 6 months before ageing them off.
  • This would require the ability to cold (or warm) start C3 to generate CE3 start dumps - The proposal of keeping G3 start dumps once a day after 6 months means that C3 can be started on any day to produce start dumps for CE3.
  • This would increase the computational cost of trials!
  • The subarea and frames would need to be retained for the full period.
Estimates for this proposal

  • Start dumps for all domains for 6 months: 7 (domain) x 4 (cycles) x 183 (days) x 6.8 Gb (start dump) = ~35 Tb

  • Frames (whole period): 7 (domains) x 4 (cycles) x 3 (years) x 365 (days) x 2.5 Gb = 77 Tb

  • Subareas (whole period): 7 (domains) x 4 (cycles) x 3 (years) x 365 (days) x 475 Gb = 15 Tb

  • Total: 127 Tb

Reanalysis

BARRA 12 km national reanalysis and 1.5km subdomains over Adelaide, Perth, Sydney and Tasmania:

  • BARRA-R t+0h Analysis per (6-hour) cycle: 12 G
  • BARRA-R t-3h start dump per cycle: 12 G
  • BARRA-R SM analysis per cycle: 39 Mb
  • BARRA-R daily SST ancillary from OSTIA for one year: 8 Gb
  • BARRA-R static ancillary: 125 Gb
  • Obs for 2015: 545Gb (aus_local - satellite, conventional, profiler), 284 Gb (ecmwf - conventional, satellite radiances), 9 G (ROMSAF GPSRO)
  • BARRA-R ERA-Interim frames for one-year: 11G
  • BARRA-R LBC dumps over 9h per cycle: 7Gb
  • BARRA-AD, BARRA-SY, BARRA-PH, BARRA-TA static ancillary: 284 Gb

A year of data: 8.3 Tb (Only 1 analysis per day)

Projections

BARPA 12km projections over central+eastern Australia, and 2.2km over midlatitude Australia and 4.4km over tropical Australia:

  • BARPA-R restart dumps per 10-day cycle: 14 Gb
  • BARPA-R LBC dumps: 7.2 Gb
  • BARPA-R ERA-Interim frames for one year: 275 Gb
  • BARPA-R SST ancillary from ERA-Interim for one-year period: 4.3 Gb
  • BARPA-R ozone ancillary for one-year period: 3.3 Gb
  • BARPA-R aerosols ancillary for one-year period: 29 Gb
  • BARPA-R static ancillary: 22 Gb
  • BARPA-CT, BARPA-CM SST ancillary from ERA-Interim for one-year period: 5.6Gb, 1.6 Gb
  • BARPA-CT, BARPA-CM ozone ancillary for one-year period: 19Gb, 5 Gb
  • BARPA-CT, BARPA-CM aerosols ancillary for one-year period: 164 Gb, 45G
  • BARPA-CT and BARPA-CM static ancillary: 125Gb, 35Gb

A year of data: 1.3 Tb (assume aerosols and ozone climatology, and thus excluding aerosols and ozone timevarying ancillaries)