ET ACDM 2021 2 - wmo-im/et-acdm GitHub Wiki
Date and Time
25 March 12:00-14:00 UTC (13:00-15:00 Geneva)
Venue
Telecon
Invitees / Participants
- Jörg Klausen (@joergklausen, chair)
- Stoyka Netcheva (@Netcheva, WMO)
- Anna Milan (@amilan17, WMO)
- Timo Proescholdt (@kurt-hectic, WMO), partly
- Judd Welton (@ejwelton)
- Gao Chen
- Kjetil Tørseth
- Debra Kollonige
- Ryan Stauffer
- Atsuya Kinoshita
- Keiichi Sato
- Markus Fiebig
- Tom Kralidis
- Martin Schultz
- Tomoaki Nishizawa (SKYNET)
- Jeannette Wild
- Damien Boulanger
- Claudia Volosciuk
- Martine de Mazière
- Valérie Thouret
- Christopher Lehmann
Excused
- Eduardo Landulfo
- Melissa Puchalski ([email protected], CASTNET Clean Air Status and Trends Network, https://www.epa.gov/castnet)
- Bill Sukloff ([email protected]), CAPMON - Environment and Climate Change Canada (ECCC)
- Terry Nakajima ([email protected]; [email protected]), SKYNET
- Bret Schichtel, [email protected], IMPROVE)
- Alex Vermeulen
- Dietrich Feist
Agenda
-
Welcome, acceptance of agenda (5')
-
Acceptance of minutes of previous meeting (5')
-
Code list management in WMO [AM, 15' + 10' discussion]
-
Conclusions from SSC meeting [jkl 10’ + 15’ discussion]
-
Use cases for WIGOS metadata and strategies for XML file generation
a. Use cases and strategies [jkl 10' + 10' discussion]
b. Helper application to generate and upload XML files [Timo Pröscholdt, 10' + 10' discussion]
-
Progress on DOI and NetCDF implementation at WDCGG [AK, 10']
-
AOB [all 15’]
a. Outline of Report on status of QA/QC methodology and procedures at data centers
-
Next meeting proposed for 25 May 11:00-13:00 UTC (13:00-15:00 Geneva)
Minutes
1. Welcome, acceptance of agenda
2. Acceptance of minutes of previous meeting
3. Code list management in WMO
Anna Milan, WMO, Infrastructure Commission, provided short overview of the Amendment Process for WMDR and Codes Registry and responded to questions in connect of the work of ET-ACDM and the Code Registry. The presentation included information on how changes in WIGOS, Code Lists, etc. are handled by WMO. Who does what, how is done, flow chart of moving request for changes (variables and names are hot topic), responsibilities and approval, timelines, publishing process. 2 types of processes exist fast track and standard. 2 fast track cycles are set in place in one year. 1st starting in February and ending in June and the 2d Starting in July and ending in November. WMO is considering how make this process more continuous. All stages in single cycle were described in who is responsible and what is the objective. List of refences was provided.
4. Conclusions from SSC meeting
SSC meeting was held 8,9 and 11 February 2021. Joerg Klausen presented the report and plans prepared through discussion of the group that included some questions/request for guidance to SSC. The action Items from SSC included one Action Items relevant to the work of the team which is the implementation of WIGOS MD (AI-19.7). GAW will held its next symposium from 28 June to 2 July 11:30 am – 2:30 pm CEST in preparation for the next implementation Plan. The topics of discussions/sessions include: Session 1: Science for services: The importance of atmospheric composition; Session 2: Filling critical gaps in observations; Session 3: Atmospheric composition, pandemics and support for a new health agenda; Session 4: Earth system modelling and data management; Session 5: Future of GAW and reflection on the Symposium. The sessions will include oral and poster parts, oral parts will be a mixture of plenary presentations and panel discussions.
Formal announcement for the symposium will follow shortly and call for abstracts. The team is encouraged to actively participate in discussions which will shape the future priorities of GAW and to ensure that the topics of DM are discussed, properly reflected.
5. Use cases for WIGOS metadata and strategies for XML file generation
a) Following the troubleshooting and helping Keichii, Joerg Klausen proposed a template that could be used by other networks in creating xml files which he and community could keep augmenting and use as reference or help in the future. The template will be posted and updated (will be live) on our github for contribution or could be used to test and ask questions if something does not work. Judd had prepared and posted similar tools in Json at MPLNET site. For the comparison of the files he recommends Notepad++ with the optional XML Tools add-on if you don't have any more specialized tools like XMLSpy at hand.
b) Timo Proescholdt, WMO, Infrastructure Commission, presented features and made a demo of the New to be released WIGOS tools for editing information. The tool will be open and available publicly shortly after this meeting (next week). Surface Station Template is available to registered users from OSCAR/Surface website and close to intuitive with some information to select from prepopulated fields. The Station Templates were developed through a WMO project, following OSCAR/Surface user requirements, in order to provide an easy way to manually register new stations of the most frequent types. The approach was to provide users with simple forms containing as few as possible of the mandatory fields for a specific station type and to automatically calculate other fields in the background based on the user inputs. Currently four different station templates are available, from the “Management” tab in OSCAR/Surface. Since the templates were implemented in a modular way, more station templates could be added easily in the future for other station types. The templates contain the functionality to register a new station and to save it in OSCAR/Surface. A new interface for entering the reporting schedule of observations was also added as part of the templates and in the generic edit form of OSCAR/Surface as well, to provide a more intuitive layout to create schedules. OSCAR/Surface Web Client Tool has been recently developed which allows batch operations in OSCAR/Surface. It is convenient to use for importing large number of stations. It could be used for creating stations, changing WIGOS ID and affiliations, also for reflecting changes in the schedule. Timo committed to send information on its launching to the team to take advantage of its features. He also offered information or help to those who needed. Training material will be also available. WIGOS Learning Portal is visible to everyone without any login. NFPs (WIGOS, OSCAR/Surface and WDQMS) are encouraged to register.
6. Progress on DOI and NetCDF implementation at WDCGG
Atsuya Kinoshita presented short summary on the progress made by WDCGG in implementing DOIs since March 2021. DOIs provided by the data provider and reserved as the only DOI and no other DOI is provided by WDCGG. Two types of granularity of DOI are provided: a) for gas specie and b) data set. It could be provided at dataset level upon request of data provider. For each data set the same DOI will be used even if data set is updated, yearly fixed dataset from all stations. In addition WDCGG started providing data in NetCDF Data format in March 2021. Data users can choose data format between text data and NetCDF formats.
7. Report on QA/QC Methodology used by WDC and Contributing Networks
Status of QA/QC Methodology and Work-Flows at WMO/GAW World Data Centers (WDCs) and Contributing Network’s Data Centers (CDCs) was presented by Claudia. She proposed the report outline with the plan for having version 0 for input and comments before GAW symposium.
The following is the intended outline of the report
Motivation and Background
Generic work-flow for QA/QC of atmospheric observations
Insert a BPMN diagram or similar, showing the steps involved; serves as a guide to the document at the same time.
Formal validation
Screening of Submitted Station Data for Quality Control
In-depth Assessment of Data Quality
Statistical tests
Versioning of data sets incl. potential reprocessing
Training material
Recommendations
To be developed once the other chapters are more mature: