ET‐ACDM‐2024‐2: 12 March 2024 - wmo-im/et-acdm GitHub Wiki

Date and Time

12 March 2024 12:00-13:30 UTC (13:00-14:30 Geneva time)

Venue

Telecon

Attendance: Keiichi Sato, Kaisa Lakkala, Gao Chen, Jörg Klausen, Markus Fiebig, Kjetil Torseth, Judd Welton, Teruo Kawasaki, Tom Kralidis, Anna Milan, Sergi Moreno

Notes

1. Agenda from last meeting approved ET-ACDM 2024-1

2. GAW updates from Secretariat:

New GAW Head Paolo Laj visited the WMO Secretariat, he will start in May.

Next meetings:

3. Level zero data (Kaisa)

Kaisa (EUBrewnet) asked for guidance on what is considered 'raw data'.

Background information:

ACTRIS level 0 data: Raw sensor output, either mV or physical units. Native resolution, metadata necessary for next level.

ICOS: As ICOS is committed to provide all data and methods in an open and transparent way as free data, a dedicated system is needed to secure the long term archiving and availability of the data together with the descriptive metadata that belongs to the data and is needed to find, identify, understand and properly use the data, also in the far future, following the FAIR data principles. An added requirement is that the full data lifecycle should be completely reproducible to enable full trust in the observations and the derived data products.

1.3.1.1 Raw data Raw data are information or objects directly obtained from human measurements or automated sensors and having received no transformation since. They can provide a quantitative or qualitative information about physical variables of the environment, and may be of different forms like images, text files, human activities recordings, or physical samples. Raw data is a subset of L0 data: 1.3.1.2 Level 0 data Level 0 data are data in physical units either directly provided by the instruments or converted from engineer units (e.g. mV, mA, Ω) to physical units at the TC. They may have been filtered by a quality check (e.g. thresholds).

Conclusions:

  • Raw data is defined as the output of an instrument or sensor without any processing or transformation, including calibration factors.

  • However, instrument firmware and calibration factors may influence that raw data. Also, depending on the users, some would like the data without calibration factors applied and other would like the data without any modification at all, which in some cases is practically impossible.

  • Raw data and level 0 data can be considered the same with some exceptions, for example large amounts of raw data that need to be condensed would be level 0 data.

  • GAW Programme can't 'force' stations to provide level 0 data, however strongly recommends to follow the published SOPs.

  • WDCRG/WDCA only asks for level 2 data, it is expected that countries have track of their data though.

  • Suggestion to have a 'general' WIGOS definition for level 0 data and open the discussion for each GAW domain (SAGs) define what is level 0 data

Action: https://github.com/wmo-im/et-acdm/issues/23

4. Actions table discussion (https://wmoomm-my.sharepoint.com/:w:/g/personal/smoreno_wmo_int/ES1CKVfo2htAkjc5Vp8ODpUB0dPpac3HtHAcPymC3asKPQ?e=f1fLTu)

Discussion centered in the Actions Table comments:

  • MPLNET developing common metadata in JSON format across the networks would it be compliant with existing OGC standards? a summary of the WMO-OGC interaction has been showed by Jörg/Tom.

  • Questions about the format to report uncertainty to WDCGG, SAG-GHG to come up with an answer.

  • Concerns about the interaction with GAWSIS by Contributing Networks. OSCAR Next Gen should fix these concerns, they should be specific and both Contributing Networks and OSCAR team should collaborate to find best way to solve the current problems.

  • Next meeting

    • Clarify how WIGOS relates to upcoming WIS 2.0
    • @tomkralidis to explain WIS 2.0 for atmospheric composition using real life examples

  • Concerns about data formatting in NDACC, recommendation to be machine-actionable.

  • Concerns about lack of expectations as a team in the ET-ACDM actions table, but more ideas related to the individual WDCs.

Action: to forward the document to SSC-EPAC (@Sergi)

5. Status of WIS 2.0 topic hierarchy (https://github.com/wmo-im/wis2-topic-hierarchy/tree/et-acdm-topics/topic-hierarchy)

Anna commented on the atmospheric composition WIS 2.0 topic hierarchy:

  • Intended to be use for NRT data

  • Other disciplines have split topics in between space-based and surface-based observations

  • Recommendation to shift the topics to a higher level if they are the only ones at the end of the tree

  • Concerns about topics too broad (aerosols particles and clouds) meaning too many notifications will be received by subscriptors

  • Suggestion to bring examples where user could find difficulties with the current hierarchy to be discussed

  • Open discussion: (https://github.com/wmo-im/et-acdm/issues/20)

6. Next meeting: 2nd May 2024 at 13:00 CEST (11:00 UTC)