Collection of Info for the OSCAR MetaData Understanding and Handling

Steps Taken During Environment Setup and Use of WMO MD Handling Examples
WDCs and CDCs Contact List
Useful Links
OSCAR Video Tutorials

Personal (DV) Notes: Steps Taken During Environment Setup and Use of WMO (Timo’s) MD Handling Examples

WMO (Timo's) examples are in GitHub can be found: https://github.com/kurt-hectic/wmo-api-webinar.git

Setup

Download and Install Anaconda
Download and Install GIT (With Timo’s guidance I have done it; I do not know where exactly it is), however:

Searching on my laptop for GIT, I find GIT CMD App, GIT GUI and GIT Bash
Choosing GIT CMD App there are several options: Open (opens CMD terminal C:\Users\drale> and if you type git you get usage: git […..])
Choosing “Open File Location” I see the path: Microsoft > Windows > Start Menu> Programs > Git: Git Bash, Git CMD and Git GUI
Would like to try Git GUI
I do not have Github.

Cloning Timo’s setup:

Go https://github.com/kurt-hectic/wmo-api-webinar/ and choose Clone or Download and then either Open in Desktop or Download ZIP options (I may have done both). And it was stored in my Documents. Anyhow, in doing so I created 1 or more wmo-api-webinar copies in my Documents, which later I got rid of (do not know when exactly in this process) Back to CMD Terminal, cd to Documents/wmo-api-webinar/master and execute pip install -r requirements.txt (to get libs and it worked). While in the Documents/wmo-api-webinar/master dir, tried executing git remote and it failed. It may be at this stage I got rid of the multiple dirs..
Cd to Documents,
I now went for HTTPS cloning (?) (link: https://github.com/kurt-hectic/wmo-api-webinar.git). That is the 3rd option. On the CMD line execute: git clone https://github.com/kurt-hectic/wmo-api-webinar.git and sub directory Documents/wmo-api-webinar was created. All Timo’s staff is there.

Tips:

To update my version from Timo’s use: git pull
To get (newer) development version as it was needed to run Example #4 pip install git+git://github.com/kurt-hectic/oscar-client.git@develop

Running (Emulating) Timo's Examples

Launched ANACONDA Navigator and via Environments>base(root) started Jupyter Notebook. Navigated to Documents/wmo-api-webinar where I could see Timo’s files and examples.
Running Timo’s Examples (I created Token earlier via OSCAR):

Example #0 (Simple API upload): executed cell by cell and it worked (see output below):

uploaded ok, but with warnings. new id 47483 log The list below is organized by section header and shows exceptions/issues â�� if any â�� that may have resulted from the processing of the XML (NB: Section headers are always displayed). # Facility with identifier "0-20000-0-teststationblog" REF_5: ReferenceType for "facility/programAffiliation/programAffiliation xlink:href" with URL "http://codes.wmo.int/wmdr/GOS2" could not be found. Information for "facility/programAffiliation" is discarded.

Example #1 (Changed Stations): executed cell by cell and it worked (see output below):

ADAMCLISI was modified on 2020-01-19 00:02:00 ADJUD was modified on 2020-01-19 00:02:00 ALBA IULIA was modified on 2019-01-24 00:12:00 ALEXANDRIA was modified on 2019-01-26 00:09:00 APA NEAGRA was modified on 2020-01-19 00:02:00 ARAD was modified on 2019-01-26 00:09:00 BACAU was modified on 2020-01-19 00:02:00 BACLES was modified on 2020-01-19 00:02:00 BAIA MARE was modified on 2019-01-19 00:12:00 BAILE HERCULANE was modified on 2019-01-26 00:09:00 BAILESTI was modified on 2020-01-19 00:02:00 BAISOARA was modified on 2019-01-19 00:12:00 BALEA LAC was modified on 2019-01-08 00:08:00 BANLOC was modified on 2019-01-19 00:12:00 BARAOLT was modified on 2019-01-19 00:12:00 BARLAD was modified on 2020-01-19 00:02:00 BARNOVA was modified on 2019-01-19 00:12:00

Example #2 (Re-Create Volume A): Not tried yet.
Example #3 (Update Stations): While executing cell by cell: it could not find jellyfish lib. Timo suggested piping it (pip install jellyfish) which I did. It continued running but failed at the very end when saving. It looks I do not have authorisation (see below): updating station 0-20000-0-10505 validates ok INFO:oscar_lib.oscar_client:Access not granted (401) error INFO:root:uploaded original XML to set gml:id. Status: AUTH_ERROR

Exception Traceback (most recent call last) in 21 22 ---> 23 station.save(client) 24 print("saved",wigos_id) 25

~\anaconda3\lib\site-packages\oscar_lib\station.py in save(self, client, override_doublesave) 232 233 if not status in ['SUCCESS_WITH_WARNINGS','SUCCESS']: --> 234 raise Exception("error saving original XML ({})".format(status)) 235 236 new_xml = str(self)

Exception: error saving original XML (AUTH_ERROR)

Example #4 (Create Stations): executed cell by cell and it failed very early in the setup (see below):

ImportError Traceback (most recent call last) in 10 import re 11 ---> 12 from oscar_lib import OscarClient, Station, OscarGUIClient 13 14 import pkg_resources # part of setuptools ImportError: cannot import name 'OscarGUIClient' from oscar_lib' (C:\Users\drale\anaconda3\lib\site-packages\oscar_lib_init_.py)

WDCs and CDCs Contact List

WDCGG: World Data Center for Greenhouse Gases in Tokyo/Japan; Contact: Atsuya Kinoshita; [email protected]
WRDC: World Radiation Data Center in St Petersburg/Russia; Contact: Anatoly Tsvetkov (Head of WRDC) [email protected] , [email protected] , [email protected]
WDCRG: World Data Center for Reactive Gasses & WDCA World Data Center for Aerosol in Oslo/Norway; Contacts: Markus Fiebig (Senior Scientist) , [email protected] and Kjetil Tørseth (Department Director), [email protected]
WOUDC: World Data Center for Ozone and UV Radiation inToronto/Canada; Contact: Tom Kralidis (Head of WOUDC), [email protected]
WDCPC: World Data Center for Precipitation Chemistry in USA Collocated with NADP (National Atmospheric Deposition Program); Contact: Christopher Lehmann (Head of WDCPC) [email protected]
SHADOZ: Southern Hemisphere Additional Ozonesondes; SHADOZ contacts: Debra E. Kollonige (Data Manager), [email protected] and Ryan M. Stauffer (PI/Head and QC/QA): [email protected] [email protected]
NDACC (Network for the Detection of Atmospheric Composition Change): Contacts : Anne M. Thompson (former SHADOZ Head and co-Chair of NDACC expected to retire as co-chair at the end of 2021) [email protected], Martine De Mazière (co-Chair of NDACC), [email protected], NDACC data manager: Jeannette Wild [email protected]
NASA data centre aircraft studies and NDACC new data center, Contact: Gao Chen [email protected]
GALION: GAW Aerosol Lidar Observation Network and MPLNET: the NASA Micro Pulse Lidar Network (EARLINET is the European component of GALION), Contact: Ellsworth Judd Welton (Chair) [email protected]
LALINET: Latin American Lidar Network in Brazil; Contact: Eduardo Landulfo, [email protected] ; [email protected]
INDAAF- Africa: International Network to study Deposition and Atmospheric Africa; Contact: Corinne Gally-Lacaux, [email protected] , [email protected]
CASTNET: Clean Air Status and Trends Network – EPA (Environment Protection Agency, HQ Washington DC); Contact: Melissa Puchanski [email protected]
TCCON: TOTAL CARBON COLUMN OBSERVING NETWORK; Contact: Dietrich Feist (TCCON Deputy Chair for Africa & Europe): [email protected]
CAPMON: Canadian Air and Precipitation Monitoring Network by Environment and Climate Change Canada (ECCC); Contacts: Bill Sukloff: [email protected] and Amanda Cole [email protected]
EANET: Acid Deposition Monitoring Network in East Asia; Contact: Keiichi Sato, [email protected] , [email protected]
SKYNET: Skyradiometer Network is International ground-based radiation observation network dedicated to aerosol-cloud-solar radiation interaction researches organized in seven regional sub-networks with their Regional SKYNET Data Centers (RSDC) and International SKYNET Data Center (ISDC); Contact: Terry Nakajima (Chair) [email protected]; Web site [email protected]
ICOS: Integrated Carbon Observation System in Lund, Sweden; Contact: Alex Vermuelen (Manager), [email protected]
IMPROVE: Interagency Monitoring of Protected Visual Environments based on AOD-Aerosol Optical Depth in USA Colorado State University; Contact: Bret Schichtel [email protected]

Useful Links

WIGOS Learning Portal: https://etrp.wmo.int/course/view.php?id=146&section=1; with 4 sections:

WIGOS General
OSCAR/Surface
WDQMS and RWC
Regular Webinars on OSCAR/Surface and WDQMS (in particular Webinar#1, Webinar#12 and Webinar#13)
Other Relevant Learning Material