DAWW202403 - ACCORD-NWP/Doc_officer_test GitHub Wiki

DAWW202403

Working Week: Diagnostics, remote-sensing observations, variational algorithms, ML + DAsKIT support (RD8, RD2, RD5, RD9)

{{toc}}

Evidence

!{width: 32%}da_presentations.jpeg! !{width: 32%}group_photo_long_room.jpeg! !{width: 32%}group_photo_hq.jpeg!

Details

Dates: 11 - 15 March, 2024

Times: NOTE - all times are local (UTC or CET-1)

Venue: "Invent Fusion" Room (seats 20), DCU Alpha (adjacent to Met Éireann), Glasnevin, Dublin, D11 KXN4

How to connect:

Microsoft Teams meeting "Click here to join the meeting":https://teams.microsoft.com/l/meetup-join/19%3ameeting_OWUwYjg5ZTgtYTM5ZS00OGY2LTk0MjEtYzhkYjA4Nzg1Njdk%40thread.v2/0?context=%7b%22Tid%22%3a%2250f92bd1-4712-4111-953d-7d378a5e8ad0%22%2c%22Oid%22%3a%228ddec309-abb1-4a81-a983-368a12c26bd9%22%7d

Meeting ID: 322 250 864 07 Passcode: izGUV6 "Download Teams":https://www.microsoft.com/en-us/microsoft-teams/download-app | "Join on the web":https://www.microsoft.com/microsoft-teams/join-a-meeting "Learn More":https://aka.ms/JoinTeamsMeeting | "Meeting options":https://teams.microsoft.com/meetingOptions/?organizerId=8ddec309-abb1-4a81-a983-368a12c26bd9&tenantId=50f92bd1-4712-4111-953d-7d378a5e8ad0&threadId=19_meeting_OWUwYjg5ZTgtYTM5ZS00OGY2LTk0MjEtYzhkYjA4Nzg1Njdk@thread.v2&messageId=0&language=en-US

Main topics

  • Diagnostics, AccordDATools repository (RD8)
  • Remote-sensing observations, validation of radar data from NIMBUS (RD2)
  • Variational algorithms (3D-Var, 4D-Var in OOPS) (RD5)
  • Introducing ML methods in DA (RD9)
  • DAsKIT support

Agenda (all times in GMT/UTC, CET-1)

All days

  • Coffee at 1030/1430
  • Lunch at 1230

Monday

Session on ground-based remote sensing:

Session on diagnostics:

Session on variational algorithms:

Tuesday

Wednesday

Thursday

  • 9:00 - 10:00 Plans/progress reporting by working groups (remote connection)
  • 10:00 - 17:00 Practical work in groups
  • WW Meal - Dinner in The Bald Eagle at 1900 UTC

Friday

  • 9:00 - 11:00 Practical work in groups (summary preparation)
  • 11:00 - 13:00 Common wrap-up and closing, lunch (remote connection)
    • Eoin Whelan on behalf of RD8: attachment:DAWW202403_RD8_wrapup.pdf

Practical work items

RADAR:

DIAGNOSTICS:

  • integration of new commits to AccordDaTools repository
  • refinement, implementation and validation of various diagnostic methods

DAsKIT support:

  • analyze the experiments with CANARI
  • cycling with OI and 3D-Var using cy43

ALGORITHMS:

  • implementation of 4D-Var in OOPS
  • Checking MASTERODB rc2 functionality
  • Functionality of radar and gnss in cy46 4dvar.
  • cycling with OI (and 3D-Var?) - DAsKIT

Some instructions Download run MASTERODB 4D-VAR cy46.rc2 (standard domain)

  1. checkout own version rc2 (reference NL domain):

on perm /perm/smx/git/

Opt 1. Use pre-existing version; /home/hlam/harmonie_release/git/tags/harmonie-46h1.rc2

or checkout (correct Eoin ..?) 1024 git clone [email protected]:Hirlam/Harmonie.git /perm/smx/git/harmonie-46h1.rc2 1025 ls -lrt 1026 cd harmonie-46h1.rc2 1027 git remote -v 1028 git checkout tags/harmonie-46h1.rc2 git describe

  1. set up your 4dvexp on home dir

on your home dir

if opt one preexisting:

976 ln -sf /home/hlam/harmonie_release/git/tags/harmonie-46h1.rc2/config-sh/Harmonie 977 ./Harmonie setup -r /home/hlam/harmonie_release/git/tags/harmonie-46h1.rc2/ -h ECMWF.atos -c AROME_4DVAR

or if opt 2 if checked out 1008 ln -sf /perm/smx/git/harmonie-46h1.rc2/config-sh/Harmonie 1009 ls -lrt 1010 ./Harmonie setup -r /perm/smx/git/harmonie-46h1.rc2/ -h ECMWF.atos -c AROME_4DVAR

  1. modify file due to recent issue with openmp modules at ecmwf atos

https://github.com/Hirlam/Harmonie/pull/1052/file

then change file /home/smx/hm_home/4dv_rc2/config-sh -rwxr-x--- 1 smx accord 5947 Mar 7 18:52 config.ECMWF.atos_bk -rwxr-x--- 1 smx accord 5953 Mar 7 18:53 config.ECMWF.atos [smx@ac6-100 config-sh]$ diff -i config.ECMWF.atos config.ECMWF.atos_bk

use module load hpcx-openmpi/2.9.0 instead of module load openmpi/4.1.1.1

use module load hpcx-openmpi/2.9.0 instead of module load openmpi/4.1.1.1

  1. Launch exp

first cycle ./Harmonie start DTG=2024011009

then next cycle with da

./Harmonie prod BUILD=no

Wrap-up

WW Dublin Progress Report 11-15 march 2024

RD2 remote sensing observations

Radar work during the WW Dublin Participants: Maud, Michal, Antonin, Mats, Gunther, Jana, Martin

METEO FRANCE Comparison of Nimbus and Odyssey radar data files in order to understand differences in experiment using these two data sources. specification of file naming (discussion with MF IT team) to be able to ingest Nimbus data properly in MF operational observation database. With all these elements, it will be possible to change OPERA radar data in AROME-France operational production line from Odyssey to Nimbus production center.

LACE Comparison of Nimbus and Odyssey 15min volume radar data files were checked over period of 3-10 March 2024. Comparison plots were produced to get overview of differences between the Nimbus and Odyssey data. A two day assimilation cycle was run to compare availability of processed observations in the NWP model, which shows small differences in amount of data read from Nimbus and Odyssey for most of the radar sites. The data of several randomly picked radar stations were compared by similarity index between Nimbus and Odyssey files. The similarity index shows by one number similarity between two fields. Both data sources had a good agreement for processed stations by similarity index.

HARMONIE

  • Some results for METCOOP and UWC-W with NIMBUS data have been finished and added to AEMET results.
  • A BUG was corrected in prepopera4.py and now a version prepopera4.1.py has been created.
  • We have decided to use 15 min volume files for France instead of 5min files so to include all the elevations available and therefore make a better vertical profile. It will be the domains UWC-W and AEMET who will use them.
  • Run and evaluate 5-min Nimbus and Arcus radar experiments for 15 to 30 June 2023.

ACCORD

  • Testing of all NIMBUS data compared to OIFS and ODE: problems with uk radars and swiss radars. Also with Spanish optimised wind files
  • We are writing a common document to present to OPERA next week.

RD8 Diagnostics Participants: Eoin, Jana, Joan, Isabel, Stephanie, Martin, Mats, Zeynep -Desroziers Method: Stephanie, Jana and Magnus:included geopotenial calculations so to be able to diagnose shipz-z, dribu-z and synop-z , Martin:updated scripting system to make it easy to use and added STD and ZTD, Mats -Obstool: Stephanie (see presentation) Diagnostics:

Coordination meeting with Stephanie, Bennjamin,Magnus,Jana and Martin on Tuning activities.

  1. Benjamin presented progess of BGOS (BACkground error in observation space) tool. Works in oops cy46 framework with QG model and conv obs. Progress to run with harmonie arome and extend to more observations. Output is background error randomisatins of B matrix in odb observation space.
  2. Stephanie will help with extend bgos to satellite data and Jana and Martin to gnns and radar.
  3. Different thinning approached for input data for diagnostics of observation error correlations were discussed. Wether to provide as input unthinned data or a combination of unthinned active data as well as thinned passive data. Different approaches will be investigated.
  4. A coordniation tuning status meeting will take place in Norrköping during ACCORD ASM.
  5. Date for ACCORD DAP in Oslo will be discussed later but likely in autumn 2024 (November).

RD5 4DVAR Participants: Jan, Pau, Magnus, Swapan, Isabel, Jana, Martin, Mats et al.

MASTERODB and OOPS 4dvar progressed as desrcibed in detail "here":https://opensource.umr-cnrm.fr/attachments/5632/4dv_finrep_dublin_ww.pdf

DAsKIT implementation

Attendees

How to reach DCU Alpha: Google Maps -- https://maps.app.goo.gl/inAEQV74hZ6aqiAJ7

Public transport: For bus and tram (LUAS) around the city, the use of a Leap Card is the most convenient way to pay. See https://www.leapcard.ie/Home/index.html. You can but a Leap Card at convenience stores at the Airport or around the city. See https://about.leapcard.ie/about/where-to-buy for details. Note: it is not possible to pay for bus journeys using your debit/credit card or by mobile app.

Suggested accommodation::

_.On-site participants
_.Name (Affiliation) _.Arrival
r (ARSO) 10.3. morning
n (Irish Met)