ET ACDM 2022 5 WG Topic 1 - wmo-im/et-acdm GitHub Wiki

Topic 1

  • Review progress on activities defined in current GAW IP 2017-2023

  • Review ‘unfinished business’ slide image

  • Review input/requirements coming from next session of this meeting

Notes

A-DM-1. Establish and implement a federated data management infrastructure including GAW Data Centres, data centres of contributing networks, and GAWSIS that enables interoperable data discovery and access mechanisms.

The concept was to have a federated infrastructure that hides complexity of providers.

Problems on the providers with the PI. repository to redirect users to the data providers. WIGOS MD is the foundation on which we should build the metadata mgt. Another way is the provider to choose their format and then be translated to the wdc. WDC needs to provide the support to help the provider to accomplish.

Metadata you need it for discovery. Improve the current support to the providers to take advantage of the metadata scheme. a possibility would be to test the metadata before, a dedicated pilot. Volunteers required to test. We do need a single schema for all the data.

WDC should implement libraries. WIGOS metadata may not satisfy all the specialized areas directly, but there are extension points to satisfy specific requirements.

Target WDC to run a pilot to map their metadata to WIGOS metadata and for the ET to review it. It should not take too long at least to find out about deficiencies.

Map the attributes from the WDC into the WMDR2.0 -way action WIGOS-WDC. Need to be clear about the purpose. Where is that metadata going? What is the metadata for? The records can be centrally collected in OSCAR, but not all complexity f. ex. In ICOS data file is not simple, f.ex. ancillary data. You need a goal to make the changes, otherwise is only a concept. Documentation needs to be described in this model, the target is harmonisation. Large amounts of data, current mgt system is not fit for purpose, however no clear ambition from the Data Centres to manage that data. For the current data mgt, easier the access, data format should not be an issue. Large users have less problem than small ones with harmonisation.

Use cases: 1 variable from an area and period; or 1 geographical region and look for all species. For example, to assess CO2, it would be great to have access to other measurments that can support to understand the processes in a seamless way.

A-DM-2. Improve open access to data and comprehensive metadata including calibration histories of ground-based, aircraft and satellite observations for the primary GAW variables.

A-DM-3. Harmonize GAW data management activities with the WIGOS framework, in particular with regards to metadata documentation.

A-DM-4. Develop and promote support of data archiving and analysis centres that address the needs of applications and service delivery.

A-DM-5. Ensure that data collected and archived by WMO/GAW WDCs and archives of contributing networks are of known quality, adequate for their intended use and documented comprehensively.

A-DM-6. Promote delivery of those variables pertinent to air quality and forecasting in NRT, using WMO GTS/WIS as it evolves into an open, decentralized and node-oriented structure. Continue to seize opportunities to expand the NRT delivery services for GAW variables.

A-DM-7. Develop data submission and data use procedures with the inclusion of uncertainties with the GAW data products, making it possible to select and use data in accordance to the criteria set out by the RRR process.

A-DM-8. Continue to make best efforts towards programme-wide adoption of digital object identifiers (DOIs) for GAW datasets to facilitate proper recognition of the data contributors in scientific analyses and reports and it will also allow for better monitoring of the actual data use.