ET ACDM Work Plan 2023 - wmo-im/et-acdm GitHub Wiki
Please review assessment of progress made on action items from current GAW IP and carry over impotarnt elements to the lists below.
Please list specific actions/tasks that your DC is working on this year in support of the current GAW IP 2016-2023.
A-DM-1. Establish and implement a federated data management infrastructure including GAW Data Centres, data centres of contributing networks, and GAWSIS that enables interoperable data discovery and access mechanisms.
Achievements so far:
- GAW Data Centres, data centres of contributing networks are discoverable in GAWSIS explicitly. No specific visibility in OSCAR/Surface, but links to data holdings can be provided for each observation (=data set)
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| ET-ACDM | Finalize GAW-specific requirements for OSCAR/Surface NextGen | Specific GAW requirements for the next generation OSCAR/Surface will be handed over to ET-WT and the project team at MeteoSwiss. |
| WDCGG | Integrating metadata into GAWSIS | Observational information on GHGs has been collected by WDCGG and the tool to register them in GAWSIS is almost complete. The tool will be operational after coordination with GAWSIS technical staff on some pending issues. |
| ET-ACDM | GAW data search tool | explore a practical approach and the feasibility of developing a data search tool which search data across data centres |
| blah | blah | blah |
A-DM-2. Improve open access to data and comprehensive metadata including calibration histories of ground-based, aircraft and satellite observations for the primary GAW variables. Achievements so far:
- SHADOZ Network: Latest version of ozone profile data is already open access (no passwords needed). Comprehensive metadata provided within each data file.
- EUBREWNET: Automatic submission of total ozone level 2.0 data to WOUDC. Each file includes comprehensive metadata.
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| SHADOZ Network | Make Latest data and uncertainties available on WOUDC | Deliver V06 data and V01 uncertainties to WOUDC for all for 14 stations. |
| WDCGG | Coordination of views on open access to observational data | On the current WDCGG website, users have unrestricted access to metadata and quick-look graphs, but user registration (log in) is required only when users download “data files”. We receive data from contributors on condition that we provide them with download information. To make data downloads open access, we need to hear the contributors' intentions; we will conduct a survey in September. |
| blah | blah | blah |
A-DM-3. Harmonize GAW data management activities with the WIGOS framework, in particular with regards to metadata documentation. Achievements so far:
- GAWSIS metadata holdings are fully integrated into WIGOS (OSCAR/Surface)
- GAWID considered a platform-specific ID for the GAW program; primary ID is WIGOS Station Identifier (WSI)
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| ... | Map metadata hierarchies/elements to WMDR1, identify issues | This is a pre-requisite for adoption of WMDR by ... and an opportunity to influence the evolution towards WMDR2 |
| ET-ACDM | Uniform Metadata Requirements | Develop a consistent basic (measurement agnostic) metadata requirements to increase data discoverability |
| blah | blah | blah |
A-DM-4. Develop and promote support of data archiving and analysis centres that address the needs of applications and service delivery. Achievements so far:
- ...
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| blah | blah | blah |
A-DM-5. Ensure that data collected and archived by WMO/GAW WDCs and archives of contributing networks are of known quality, adequate for their intended use and documented comprehensively. Achievements so far:
- SHADOZ Network: As a part of the Assessment for Standard Operating Procedures for OzoneSondes (ASOPOS) team, the network (and its stations) have adopted recommended Standard Operating Procedures (SOPs) for the measurements, data processing and homogenization, uncertainty calculations and data quality indicators from the WMO/GAW Report 268 (SHADOZ team members are co-authors on this report).
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| SHADOZ Team (with ASOPOS team) | Global/Regional webinars on GAW Report 268 | Organized in the manner of SHADOZ Regional Station meetings, ASOPOS is hosting regional webinars on the ozonesonde best practices for measurement, data processing, and data quality assurance SOPs. |
| blah | blah | blah |
A-DM-6. Promote delivery of those variables pertinent to air quality and forecasting in NRT, using WMO GTS/WIS as it evolves into an open, decentralized and nodeoriented structure. Continue to seize opportunities to expand the NRT delivery services for GAW variables. Achievements so far:
- WDCA, in collaboration with the European research infrastructure ACTRIS, has had a RT data production and dissemination service running since 2013.
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| blah | blah | blah |
| WDCA / WDCRG | Extension of existing RT data service | This service is presently being upgraded and extended to more stations and variables, including WDCRG variables, in an ongoing project for the European Copernicus infrastructure. |
A-DM-7. Develop data submission and data use procedures with the inclusion of uncertainties with the GAW data products, making it possible to select and use data in accordance to the criteria set out by the RRR process. Achievements so far:
- EUBREWNET: Total ozone data in EUBREWNET files already includes standard deviation and analysis of uncertainties.
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| WDCA / WDCRG | Uncertainties supported | Uncertainties are supported per dataset. Systematic and statistical uncertainties supported. Data providers are encouraged to report uncertainties by including them in data reporting templates. |
| WDCGG | Adding uncertainty information to observed data | Data uncertainty information will be added to each observed data. Short-term and long-term uncertainty information will be added to the data column and an item for scale transfer uncertainty will be added in the header information. We will wait for the next GAW Measurement Guide to be published before moving to implementation. |
| blah | blah | blah |
A-DM-8. Continue to make best efforts towards programwide adoption of digital object identifiers (doi) for GAW datasets to facilitate proper recognition of the data contributors in scientific analyses and reports and it will also allow for better monitoring of the actual data use. Achievements so far:
- SHADOZ Network: Created DOIs for whole V06 ozonesonde/radiosonde profile dataset as well as V01 uncertainties for each profile.
- EUBREWNET: EUBREWNET is a beta tester for DOI and landing pages in EVDC -> Granularity and one DOI for Station and Product (O3, UV, AOD).
- ...
Actions foreseen for 2023:
| Data center | Action/task # | Description |
|---|---|---|
| WDCA / WDCRG | DOIs on all archived datasets being rolled out | DOIs with associated landing pages are being defined for all archived datasets in several granularities: 1) per submsission; 2) per version of whole dataset; 3) all versions of dataset by one specific instrument at station. |
| SHADOZ Network | DOIs for each station V06 dataset being rolled out | DOIs have been created for each SHADOZ station (14 in total) for the latest V06 recommended whole (time period) dataset with associated landing pages. Final checks are in progress before final rollout to data users. |
| WDCGG | Dissemination of DOIs | The assignment of DOIs to the dataset has been completed. WDCGG will continue to promote its dissemination and use. |
| blah | blah | blah |