access_access_ge2_rdsi_info - ACCESS-NRI/accessdev-Trac-archive GitHub Wiki
#!htmlcomment
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
ooo [[PageOutline(2-8,Page Contents,inline,unnumbered)]]
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
Comment Block.
- Can contain <tags> and &entities; that will not be escaped in the output.
############ 000 access_ge2 RDS DATA ############
ooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo
ooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo
ooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo
#!div class="important"
#### NOTE: GE2 RDSI DATA OLDER THAN 12 MONTHS WILL BE AGGRESSIVELY TRIMMED (Target: February 2018)
-
The top directory for access_ge RDS data at NCI/raijin is: GE_RDS == /g/data3/dev_aps2/access-ge/
- Marked for reduction
- Note: Users need to apply to be in group "na3" to have read access
-
(1) DATA FROM 1st July 2016 to present are in $GE_RDS/gef/$YYYY/$MM/$YYYYMMDDHH
-
Full data for the past 12 months to be kept
-
(2) DATA FROM 10th Sept 2015 to 1st July 2016 are in $GE_RDS/gef_ngamai/$YYYY/$MM/$YYYYMMDDHH
-
Marked for reduction
-
(3) OLD DATA FROM ge2g1 runs (i.e. GE2 running using input from APS1 ACCESS-G system - G1, rather than APS2 - G2)
- Range from 2013122112 -to- 2015120500
- Kept in $GE_RDS/hide/GF/
- Note overlap between data in $GE_RDS/gef_ngamai and $GE_RDS/hide/GF; where duplicates occur the later gef_ngamai G2-input-based version is the one which will be kept
- GF data from 2013122112/ -to- 2014110512/ are in additional subdirectory nc/ within $YYYYMMDDHH/
- Data are not 100% complete - there are a few missing files
- Marked for reduction
-
Original pd.nc single NetCDF file per ensemble member is divided into 5 files
- 4 pressure level files containing 5 fields
- air_temp.nc, geop_ht.nc, relhum.nc, zonal_wnd.nc (2 levels)
- 1 single level fields file with 5 fields:
- single_level_fields.nc: mslp, uwnd10m, vwnd10m, temp_scrn, accum_prcp, dewpt_scrn
- Note that uwnd10m/vwnd10m fields undergo name change from yyyymmddhh onwards, to U10/V10
- 4 pressure level files containing 5 fields
-
Other pressure levels and other single level fields are being culled from the archive
-
Fields are kept at 6-hourly time intervals rather than 3-hourly in the time dimension
-
Once-daily archives from the 12UTC daily runs are being retained, 00UTC runs are being removed
-
Directory structure of data follows ACCESS_G2 convention * $GE_RDS/gef_reduced/YYYYMMDD/HH/cf * $GE_RDS/gef_reduced/YYYYMMDD/HH/pf/$ensemble_member_num
-
All files have been converted to netCDF4 and relevant global attributes updated to include metadata identifying which version of GE2 system was run, corresponding to (1), (2), (3) above.
-
single level
-
mslp
-
accum_prcp
-
temp_scrn
-
dewpt_scrn
-
u10
-
v10
-
pressure level
-
zonal_wnd @ 850 hPa
-
zonal_wnd @ 250 hPa
-
air_temp @ 850 hPa
-
relhum @ 700 hPa
-
geop_ht @ 500 hPa
- NOTE: Global attributes of "reduced data" will vary to reflect ge2 version changes.
EXAMPLE NEW GLOBAL ATTRIBUTES:
// global attributes:
:Conventions = "CF-1.5,ACDD v1.3" ;
:title = "BoM APS2 Global Ensemble Forecast data" ;
:summary = "Reduced archive of BoM APS2 global ensemble N216 10-day forecasts. This is a research trial system, not an operational Bureau system." ;
:institution = "Australian Bureau of Meteorology" ;
:expt_id = "ge2_gef_reduced" ;
:source = "access_gef sms suite" ;
:platform = "ngamai" ;
:da_input = "access_g1" ;
:modl_vrsn = "APS2 ACCESS-GE" ;
:date_created = "2015091012" ;
:base_date = "20150910" ;
:base_time = "12" ;
:ensemble_member = "001" ;
Single level fields: ( 81x325x432 ):
float topog(time, lat, lon) ; float sfc_pres(time, lat, lon) ;
float accum_ls_prcp(time, lat, lon) ; float accum_ls_snow(time, lat, lon) ;
float u10(time, lat2, lon2) ; float v10(time, lat2, lon2) ;
float temp_scrn(time, lat, lon) ; float tmax_scrn(time, lat, lon) ;
float tmin_scrn(time, lat, lon) ; float accum_conv_prcp(time, lat, lon) ;
float accum_conv_snow(time, lat, lon) ; float accum_prcp(time, lat, lon) ;
float visibility(time, lat, lon) ; float fog_fraction(time, lat, lon) ;
float dewpt_scrn(time, lat, lon) ; float conv_cld_amt_2d(time, lat, lon) ;
float low_cld(time, lat, lon) ; float mid_cld(time, lat, lon) ;
float hi_cld(time, lat, lon) ; float ttl_cld(time, lat, lon) ;
float mslp(time, lat, lon) ;
Multi level fields ( 81x37x325x432)
float zonal_wnd(time, lvl, lat2, lon2) ; float merid_wnd(time, lvl, lat2, lon2) ;
float omega(time, lvl, lat, lon) ; float geop_ht(time, lvl, lat, lon) ;
float air_temp(time, lvl, lat, lon) ; float relhum(time, lvl, lat, lon) ;
> ncdump -h ge2_eg.nc
netcdf ge2_eg {
dimensions:
lon = 432 ;
lon2 = 432 ;
lat = 325 ;
lat2 = 324 ;
lvl = 37 ;
time = UNLIMITED ; // (81 currently)
char_size = 4 ;
variables:
double time(time) ;
time:long_name = "time" ;
time:units = "days since 2017-09-20 12:0:0.0" ;
time:standard_name = "time" ;
time:axis = "T" ;
time:calendar = "gregorian" ;
char seg_type(time, char_size) ;
seg_type:long_name = "segment of bmrc header type" ;
float lat(lat) ;
lat:long_name = "latitudes" ;
lat:type = "uniform" ;
lat:units = "degrees_north" ;
lat:valid_min = -90.f ;
lat:valid_max = 90.f ;
lat:axis = "Y" ;
float lat2(lat2) ;
lat2:long_name = "latitudes" ;
lat2:type = "uniform" ;
lat2:units = "degrees_north" ;
lat2:valid_min = -90.f ;
lat2:valid_max = 90.f ;
lat2:axis = "Y" ;
float lon(lon) ;
lon:long_name = "longitudes" ;
lon:type = "uniform" ;
lon:units = "degrees_east" ;
lon:valid_min = -180.f ;
lon:valid_max = 360.f ;
lon:axis = "X" ;
float lon2(lon2) ;
lon2:long_name = "longitudes" ;
lon2:type = "uniform" ;
lon2:units = "degrees_east" ;
lon2:axis = "X" ;
float lvl(lvl) ;
lvl:long_name = "vertical levels" ;
lvl:type = "pressure" ;
lvl:units = "hPa" ;
lvl:positive = "down" ;
lvl:axis = "Z" ;
int base_date(time) ;
base_date:long_name = "base date (YYYYMMDD) of archive file" ;
base_date:units = "yyyymmdd" ;
base_date:WARNING = "DEPRECATED, DO NOT USE" ;
int base_time(time) ;
base_time:long_name = "base time (HHMM) of archive file" ;
base_time:units = "hhmm UTC" ;
base_time:WARNING = "DEPRECATED, DO NOT USE" ;
int valid_date(time) ;
valid_date:long_name = "valid date (YYYYMMDD) of this segment" ;
valid_date:units = "yyyymmdd" ;
valid_date:WARNING = "DEPRECATED, DO NOT USE" ;
int valid_time(time) ;
valid_time:long_name = "valid time (HHMM) of this segment" ;
valid_time:units = "hhmm UTC" ;
valid_time:WARNING = "DEPRECATED, DO NOT USE" ;
float forc_hrs(time) ;
forc_hrs:long_name = "forecast hours of this segment" ;
forc_hrs:units = "hours" ;
forc_hrs:WARNING = "DEPRECATED, DO NOT USE" ;
int wrtn_date(time) ;
wrtn_date:long_name = "date (YYYYMMDD) that this segment was written" ;
wrtn_date:WARNING = "DEPRECATED, DO NOT USE" ;
int wrtn_time(time) ;
wrtn_time:long_name = "time (HHMM) that this segment was written" ;
wrtn_time:WARNING = "DEPRECATED, DO NOT USE" ;
float topog(time, lat, lon) ;
topog:grid_type = "spatial" ;
topog:level_type = "single" ;
topog:units = "m" ;
topog:long_name = "topography height" ;
topog:stash_code = 33 ;
topog:accum_type = "instantaneous" ;
topog:missing_value = 1.e+36f ;
topog:_FillValue = 1.e+36f ;
float sfc_pres(time, lat, lon) ;
sfc_pres:grid_type = "spatial" ;
sfc_pres:level_type = "single" ;
sfc_pres:units = "Pa" ;
sfc_pres:long_name = "surface pressure" ;
sfc_pres:stash_code = 409 ;
sfc_pres:accum_type = "instantaneous" ;
sfc_pres:missing_value = 1.e+36f ;
sfc_pres:_FillValue = 1.e+36f ;
float zonal_wnd(time, lvl, lat2, lon2) ;
zonal_wnd:grid_type = "spatial" ;
zonal_wnd:level_type = "multi" ;
zonal_wnd:units = "m s-1" ;
zonal_wnd:long_name = "zonal wind" ;
zonal_wnd:stash_code = 15201 ;
zonal_wnd:accum_type = "instantaneous" ;
zonal_wnd:missing_value = 1.e+36f ;
zonal_wnd:_FillValue = 1.e+36f ;
float merid_wnd(time, lvl, lat2, lon2) ;
merid_wnd:grid_type = "spatial" ;
merid_wnd:level_type = "multi" ;
merid_wnd:units = "m s-1" ;
merid_wnd:long_name = "meridional wind" ;
merid_wnd:stash_code = 15202 ;
merid_wnd:accum_type = "instantaneous" ;
merid_wnd:missing_value = 1.e+36f ;
merid_wnd:_FillValue = 1.e+36f ;
float omega(time, lvl, lat, lon) ;
omega:grid_type = "spatial" ;
omega:level_type = "multi" ;
omega:units = "Pa s-1" ;
omega:long_name = "vertical velocity in pressure co-ordinates" ;
omega:stash_code = 15242 ;
omega:accum_type = "instantaneous" ;
omega:missing_value = 1.e+36f ;
omega:_FillValue = 1.e+36f ;
float geop_ht(time, lvl, lat, lon) ;
geop_ht:grid_type = "spatial" ;
geop_ht:level_type = "multi" ;
geop_ht:units = "m" ;
geop_ht:long_name = "geopotential height" ;
geop_ht:stash_code = 16202 ;
geop_ht:accum_type = "instantaneous" ;
geop_ht:missing_value = 1.e+36f ;
geop_ht:_FillValue = 1.e+36f ;
float air_temp(time, lvl, lat, lon) ;
air_temp:grid_type = "spatial" ;
air_temp:level_type = "multi" ;
air_temp:units = "K" ;
air_temp:long_name = "temperature" ;
air_temp:stash_code = 16203 ;
air_temp:accum_type = "instantaneous" ;
air_temp:missing_value = 1.e+36f ;
air_temp:_FillValue = 1.e+36f ;
float mslp(time, lat, lon) ;
mslp:grid_type = "spatial" ;
mslp:level_type = "single" ;
mslp:units = "Pa" ;
mslp:long_name = "mean sea level pressure" ;
mslp:stash_code = 16222 ;
mslp:accum_type = "instantaneous" ;
mslp:missing_value = 1.e+36f ;
mslp:_FillValue = 1.e+36f ;
float relhum(time, lvl, lat, lon) ;
relhum:grid_type = "spatial" ;
relhum:level_type = "multi" ;
relhum:units = "%" ;
relhum:long_name = "relative humidity" ;
relhum:stash_code = 16256 ;
relhum:accum_type = "instantaneous" ;
relhum:missing_value = 1.e+36f ;
relhum:_FillValue = 1.e+36f ;
float accum_ls_prcp(time, lat, lon) ;
accum_ls_prcp:grid_type = "spatial" ;
accum_ls_prcp:level_type = "single" ;
accum_ls_prcp:units = "kg m-2" ;
accum_ls_prcp:long_name = "accumulative large scale precipitation" ;
accum_ls_prcp:stash_code = 4201 ;
accum_ls_prcp:accum_type = "accumulative" ;
accum_ls_prcp:accum_units = "hrs" ;
accum_ls_prcp:accum_value = 3 ;
accum_ls_prcp:missing_value = 1.e+36f ;
accum_ls_prcp:_FillValue = 1.e+36f ;
float accum_ls_snow(time, lat, lon) ;
accum_ls_snow:grid_type = "spatial" ;
accum_ls_snow:level_type = "single" ;
accum_ls_snow:units = "kg m-2" ;
accum_ls_snow:long_name = "accumulative large scale snowfall" ;
accum_ls_snow:stash_code = 4202 ;
accum_ls_snow:accum_type = "accumulative" ;
accum_ls_snow:accum_units = "hrs" ;
accum_ls_snow:accum_value = 3 ;
accum_ls_snow:missing_value = 1.e+36f ;
accum_ls_snow:_FillValue = 1.e+36f ;
float u10(time, lat2, lon2) ;
u10:grid_type = "spatial" ;
u10:level_type = "single" ;
u10:units = "m s-1" ;
u10:long_name = "10m wind u component" ;
u10:stash_code = 3225 ;
u10:accum_type = "instantaneous" ;
u10:missing_value = 1.e+36f ;
u10:_FillValue = 1.e+36f ;
float v10(time, lat2, lon2) ;
v10:grid_type = "spatial" ;
v10:level_type = "single" ;
v10:units = "m s-1" ;
v10:long_name = "10m wind v component" ;
v10:stash_code = 3226 ;
v10:accum_type = "instantaneous" ;
v10:missing_value = 1.e+36f ;
v10:_FillValue = 1.e+36f ;
float temp_scrn(time, lat, lon) ;
temp_scrn:grid_type = "spatial" ;
temp_scrn:level_type = "single" ;
temp_scrn:units = "K" ;
temp_scrn:long_name = "screen level temperature" ;
temp_scrn:stash_code = 3236 ;
temp_scrn:accum_type = "instantaneous" ;
temp_scrn:missing_value = 1.e+36f ;
temp_scrn:_FillValue = 1.e+36f ;
float tmax_scrn(time, lat, lon) ;
tmax_scrn:grid_type = "spatial" ;
tmax_scrn:level_type = "single" ;
tmax_scrn:units = "K" ;
tmax_scrn:long_name = "screen level max temperature" ;
tmax_scrn:stash_code = 3236 ;
tmax_scrn:accum_type = "instantaneous" ;
tmax_scrn:missing_value = 1.e+36f ;
tmax_scrn:_FillValue = 1.e+36f ;
float tmin_scrn(time, lat, lon) ;
tmin_scrn:grid_type = "spatial" ;
tmin_scrn:level_type = "single" ;
tmin_scrn:units = "K" ;
tmin_scrn:long_name = "screen level min temperature" ;
tmin_scrn:stash_code = 3236 ;
tmin_scrn:accum_type = "instantaneous" ;
tmin_scrn:missing_value = 1.e+36f ;
tmin_scrn:_FillValue = 1.e+36f ;
float accum_conv_prcp(time, lat, lon) ;
accum_conv_prcp:grid_type = "spatial" ;
accum_conv_prcp:level_type = "single" ;
accum_conv_prcp:units = "kg m-2" ;
accum_conv_prcp:long_name = "accumulative convective precipitation" ;
accum_conv_prcp:stash_code = 5201 ;
accum_conv_prcp:accum_type = "accumulative" ;
accum_conv_prcp:accum_units = "hrs" ;
accum_conv_prcp:accum_value = 3 ;
accum_conv_prcp:missing_value = 1.e+36f ;
accum_conv_prcp:_FillValue = 1.e+36f ;
float accum_conv_snow(time, lat, lon) ;
accum_conv_snow:grid_type = "spatial" ;
accum_conv_snow:level_type = "single" ;
accum_conv_snow:units = "kg m-2" ;
accum_conv_snow:long_name = "accumulative convective snowfall" ;
accum_conv_snow:stash_code = 5202 ;
accum_conv_snow:accum_type = "accumulative" ;
accum_conv_snow:accum_units = "hrs" ;
accum_conv_snow:accum_value = 3 ;
accum_conv_snow:missing_value = 1.e+36f ;
accum_conv_snow:_FillValue = 1.e+36f ;
float accum_prcp(time, lat, lon) ;
accum_prcp:grid_type = "spatial" ;
accum_prcp:level_type = "single" ;
accum_prcp:units = "kg m-2" ;
accum_prcp:long_name = "accumulated precipitation" ;
accum_prcp:stash_code = 5226 ;
accum_prcp:accum_type = "accumulative" ;
accum_prcp:accum_units = "hrs" ;
accum_prcp:accum_value = 3 ;
accum_prcp:missing_value = 1.e+36f ;
accum_prcp:_FillValue = 1.e+36f ;
float visibility(time, lat, lon) ;
visibility:grid_type = "spatial" ;
visibility:level_type = "single" ;
visibility:units = "m" ;
visibility:long_name = "horizontal visibility" ;
visibility:stash_code = 3247 ;
visibility:accum_type = "instantaneous" ;
visibility:missing_value = 1.e+36f ;
visibility:_FillValue = 1.e+36f ;
float fog_fraction(time, lat, lon) ;
fog_fraction:grid_type = "spatial" ;
fog_fraction:level_type = "single" ;
fog_fraction:units = "1" ;
fog_fraction:long_name = "fog fraction" ;
fog_fraction:stash_code = 3248 ;
fog_fraction:accum_type = "instantaneous" ;
fog_fraction:missing_value = 1.e+36f ;
fog_fraction:_FillValue = 1.e+36f ;
float dewpt_scrn(time, lat, lon) ;
dewpt_scrn:grid_type = "spatial" ;
dewpt_scrn:level_type = "single" ;
dewpt_scrn:units = "K" ;
dewpt_scrn:long_name = "screen level dewpoint temperature" ;
dewpt_scrn:stash_code = 3250 ;
dewpt_scrn:accum_type = "instantaneous" ;
dewpt_scrn:missing_value = 1.e+36f ;
dewpt_scrn:_FillValue = 1.e+36f ;
float conv_cld_amt_2d(time, lat, lon) ;
conv_cld_amt_2d:grid_type = "spatial" ;
conv_cld_amt_2d:level_type = "single" ;
conv_cld_amt_2d:units = "-" ;
conv_cld_amt_2d:long_name = "conv_cld_amt_2d" ;
conv_cld_amt_2d:stash_code = 5262 ;
conv_cld_amt_2d:accum_type = "instantaneous" ;
conv_cld_amt_2d:missing_value = 1.e+36f ;
conv_cld_amt_2d:_FillValue = 1.e+36f ;
float low_cld(time, lat, lon) ;
low_cld:grid_type = "spatial" ;
low_cld:level_type = "single" ;
low_cld:units = "1" ;
low_cld:long_name = "low cloud cover" ;
low_cld:stash_code = 9203 ;
low_cld:accum_type = "instantaneous" ;
low_cld:missing_value = 1.e+36f ;
low_cld:_FillValue = 1.e+36f ;
float mid_cld(time, lat, lon) ;
mid_cld:grid_type = "spatial" ;
mid_cld:level_type = "single" ;
mid_cld:units = "1" ;
mid_cld:long_name = "middle cloud cover" ;
mid_cld:stash_code = 9204 ;
mid_cld:accum_type = "instantaneous" ;
mid_cld:missing_value = 1.e+36f ;
mid_cld:_FillValue = 1.e+36f ;
float hi_cld(time, lat, lon) ;
hi_cld:grid_type = "spatial" ;
hi_cld:level_type = "single" ;
hi_cld:units = "1" ;
hi_cld:long_name = "high cloud cover" ;
hi_cld:stash_code = 9205 ;
hi_cld:accum_type = "instantaneous" ;
hi_cld:missing_value = 1.e+36f ;
hi_cld:_FillValue = 1.e+36f ;
float ttl_cld(time, lat, lon) ;
ttl_cld:grid_type = "spatial" ;
ttl_cld:level_type = "single" ;
ttl_cld:units = "1" ;
ttl_cld:long_name = "total cloud cover" ;
ttl_cld:stash_code = 9217 ;
ttl_cld:accum_type = "instantaneous" ;
ttl_cld:missing_value = 1.e+36f ;
ttl_cld:_FillValue = 1.e+36f ;
// global attributes:
:Conventions = "CF-1.5" ;
:source = "Australian Bureau of Meteorology" ;
:expt_id = "lttj" ;
}
- ACCESS NWP Working Group main page (BoM Internal)
- APS2 ACCESS-GE Portal (BoM Internal)
- RDS home page
- Michael Naughton (michael.naughton at bom.gov.au)
- Asri Sulaiman (asri.sulaiman at bom.gov.au)