GLCFS "50 day" file transfer - glos/Documentation GitHub Wiki

One of GLOS's most valuable assets is GLCFS model output. Its nowcast data updates 4 times a day (6 hrs files). GLOS takes those files and serves them as aggregation on TDS.

NOAA-GLERL GLCFS. GLOS harvests nowcast and 120-hour forecast model results (water temperature, waves and currents) together with meteorological forcing variables (wind, air temperature) from the Great Lakes Environmental Research Laboratory’s Great Lakes Coast Forecast System on a regular basis in netCDF format. Harvest status is shown on the GLOS Buoy and Model Status page.

Due to various reasons, it's possible certain 6 hrs files could be missing, which causes gaps on TDS aggregation. In order to compensate this flaw, GLERL and GLOS have made the agreement that 50 days netcdf files should be created and sent to GLOS periodically. Therefore, all gaps shall be covered if we safely replace 6 hrs file with 50-days files in the same time period.

Every 50 days, these files are created and uploaded on GLERL server. A courtesy email is sent to GLOS contact ([email protected]) from Greg Lang at GLERL accordingly.

On the GLOS storage server, support staff downloads these files under GLCFS/Archive/Year folder (e.g., for 2016, it would be GLCFS/Archive/2016/). Staff then removes all 6 hrs files in this period under GLCFS/ Nowcast and copies those 50 days files over. Care should be taken to compare the start timestamp and end timestamp among those files. The naming convention of GLCFS NetCDF file could be used as the guide.

Once the replacement is done, staff should restart the TDS server to make the change effective immediately otherwise oddities could occur on TDS end.