access_ATIWG_006 - ACCESS-NRI/accessdev-Trac-archive GitHub Wiki

Meeting Notes: ACCESS Technical Infrastructure Rose-Cylc Working Group

Thu 08-Jul-2014 9E

Attendees: Ian, Mike, Robin Bowen, Martin, Wenming, Ilia, Asri, Peter Steinle, Scott, Say, Guo Liu, Robin Wedd, Oscar Alves

Video: Ben

Apologies: Jim, Peter Uhe

1. Rose-Cylc installation

  • Ongoing: Robin/Ben to discuss further about module on accessdev; Ben: tools on raijin can be made available on accessdev upon request
  • Ongoing: Rose updated to 2014-05; Cylc updated to 5.4.14; Cylc 6 coming in a couple of months;

NOTE: It is discussed that two versions of Rose/Cylc are kept on accessdev; one for operational stability and the other with the latest version for research

  • Working: Scott/Ben to discuss the decommission of accesscollab
  • Working: BoM/CSIRO/COE have variant IT security policy on making data/docs/content visible to external users. Robin/Scott/Ian to discuss how to impose restriction on access to public_htm@accessdev; This issue is moved to accessdev group meeting https://accessdev.nci.org.au/trac/ticket/111;
  • Working: Rose and dependent modules installed on webnm-dev for Rosebush on twister; https://accessdev.nci.org.au/trac/ticket/108;

Robin to request system admins to fix Apache related issue for Rosebush.

  • Done: FCM problem: perl does not look for the access control list to work properly for non access.admin users; FCM updated by Scott;
  • Working: Robin to chase up with NCI for a non-access.admin tester account.
  • Working: Jin Lee has requested Rosebud as part of Rose; Ian to check if Rosebud is working with all UM versions (8.3-8.6) and install as standard accessdev utility.
  • Working: Handover of Ian's duties to Robin, Asri, Martin, Peter Uhe and Wenming; Robin to look at the handover strategy and details;
  • Working: accessdev puppet update segmentation fault; Chris is going to investigate this likely memory related problem
  • Closed: Xiao reported the problem not being able to resubmit job through Cylc unless restarting the suite. Problem happens one/few time(s) a week but no other users have reported the issue.

2. Rose-Cylc training and documentation

  • Ongoing: Robin to prepare accessdev bulletin at the end of each month; June 2014 -> https://trac.nci.org.au/trac/access/wiki/AccessbulletinJun2014;
  • Working: Testing the migration from accesscollab to accessdev; Martin will add a link to Scott's wiki for testing users.
  • Working: so far the response to standard experiments does not meet the expectation; more work needs to be done to get more feedback
  • Working: NIWA Hilary Oliver's visit to BOM approved. The visit focuses on the training of using Cylc and consulting of the operational usage of Cylc at BNOC
  • Working: Consider moving access_wiki from trac.nci.org.au to accesssdev. Scott following this up with NCI, has written script for NCI to do for this move.

Ben thinks it is not a good idea; Ben/Scott and others may need to discuss this further

3. Rose-Cylc suite design

  • Working: Asri/Ilia working on rose-stem. Ilia working on including GCOM build as part of UM build, to tighten control over GCOM versions in UM; has some problems: FCM does not look for the specified GCOM lib. Action: Martin to do a simple GCOM test
  • Working: Pre-build libraries; ~access/prebuilds/um/vn9.x will be default place for um prebuilds, as per Asri's recommendation.
  • Working: Mike/Ian simplify the build config files in UM source, fcm-make directories; discussion in progress with UM Systems Team.
  • Working: Ian to complete N512 forecast suite. Some references to scripts in Xiao's directories to be moved to within suite. Peter S mentioned that radiation/aerosol fix from APS1 needs to be included in APS2. Action: Ian is testing N512 job
  • Working: Asri/Martin working on KGO rose-ana steps in rose-stem; KGO for each test is needed.

4. Review tools

  • Working[low priority]: Testing positive and it is a handy software for users; will make it a general tool for users. How-to and example may be produced; Scott may discuss this tool with UK Metoffice.

5. Other issues

  • Mike briefed UM Workshop and Met Office shared repository
  • BOM's new HPC: Robin reported that the benchmark to be released soon; tenders evaluated first half 2015 and contract expected to be signed at the middle of 2015
  • Scott has created prototype capturing statistics of UMUI jobs submitted from accesscollab & accessdev: https://stats.accessdev.nci.org.au; this technique should be applied on Rose/Cylc
  • The strategy of maintaining local Rose/Cylc modifications and possible contribution to Rose/Cylc for more general use