TDS - glos/Documentation GitHub Wiki

GLOS uses THREDDS to provide data services for numeric model and remote sensing datasets that cover the entire Great Lakes Basin, certain observation datasets that do not match the near real-time data model for continuous data sensors, and a subset of sensor data used for a custom HABs-related data viewer.

See also: TDS Inventory for a list and uses of each of the datasets.

There are five different data sources feeding data into the GLOS THREDDS catalog:

  • NOAA-GLERL GLCFS. GLOS harvests nowcast and 120-hour forecast model results (water temperature, waves and currents) together with meteorological forcing variables (wind, air temperature) from the Great Lakes Environmental Research Laboratory’s Great Lakes Coast Forecast System on a regular basis in netCDF format. Harvest status is shown on the GLOS Buoy and Model Status page (http://data.glos.us/status)
  • MTRI Remote Sensing Products. GLOS harvests derived satellite products from the Michigan Tech Research Institute in netCDF and TIFF format weekly. These products, which consist currently of water surface temperature, natural color, and three different color-producing agents for each of the Great Lakes, are delivered only when cloud-free MODIS-AQUA coverage is available for a given lake. The creation of these products is partially supported by GLOS, which displays the MTRI-derived products as provided and perform no additional processing.
  • USACE Coordinated Lake Water Levels. GLOS scrapes daily coordinated water levels published by the U.S. Army Corps of Engineers Detroit District on behalf of the Coordinating Committee on Great Lakes Basic Hydraulic and Hydrologic Data, and stores the scraped values in netCDF format.
  • HABs Sensors. Observations from a subset of the near real-time sensors streaming into the OBS DB are streamed in turn into netCDF files stored in the THREDDS catalog. These files drive the initial version of the GLOS Western Lake Erie Basin HABs Viewer, a rapidly-deployed specialized portal that is architected around netCDF data. Data parameters are the same as for OBS DB.
  • Manually curated datasets. A number of datasets have been added to the THREDDS catalog manually, including thermistor data downloaded seasonally from selected MTRI platforms; water quality and meteorological data from Ranger III, a vessel of opportunity; etc.

Archiving

GLOS does not currently archive any files in the THREDDS catalog, as all datasets are replicates of datasets maintained by the data providers – with the exception of the manually curated datasets. GLOS anticipates adding – where applicable and acceptable to NCEI – all current manually curated datasets to the NCEI archive by December 31, 2016. GLOS will also plan to add all such future datasets – where applicable and acceptable to NCEI – to the NCEI archive on an ongoing basis.

Backups

The THREDDS catalog is backed up onsite weekly to a removable HDD. Data Sharing. Data in the THREDDS catalog can be accessed through any TDS service, including OPeNDAP, WMS, WCS, and ncISO (WCS and ncISO are not depicted in Figure 1).