access_Rose_Cylc_Bom - ACCESS-NRI/accessdev-Trac-archive GitHub Wiki
#!html
<h1 style="text-align: center; color: blue"> Running Rose and Cylc on BoM machines</h1>
This wiki page describes how users can setup Rose on the Bureau's Twister and Ngamai machines. Rose is a group of utilities for managing the development of scientific application suites. It is published by the Met Office. Users must have an accounts on both Twister and Ngamai as well as an NCI account if wanting to access the Rose repositories located on accessdev.nci.org.au.
Your environment on Twister needs to be configured to allow job submission to the computes nodes as well as accessing the subversion repositories.
Twister needs to have passwordless ssh connections to the NCI machine accessdev.nci.org.au (location of rose repositories) and the compute nodes on Ngamai and vice versa. This can be acheived by creating and distributing ssh keys.
If you don't a a ssh key on Twister than create a key by running the following command:
$ ssh-keygen -t rsa
You will need to distribute the ssh key to accessdev.nci.org.au and ngamai.bom.gov.au with the following commands.
$ ssh-copy-id [email protected]
$ ssh-copy-id [email protected]
If you are not running a ssh agent then you may need to distribute the key to twister as well.
$ ssh-copy-id twister.bom.gov.au
Create or add the following lines to the file ~/.metomi/rose.conf where NCIUSER is your NCI username. eg ibc599
[rosie-id]
prefix-owner-default.au=NCIUSER
prefix-owner-default.test=NCIUSER
prefix-location.au= svn+ssh://[email protected]/home/access-svn/roses_au_svn
prefix-location.test = svn+ssh://[email protected]/home/access-svn/roses_test_svn
To check to see if you have access to the rose repositories without password prompts run:
$ svn info svn+ssh://[email protected]/home/access-svn/roses_test_svn
Your enviroment on Twister needs to be configured so that rose and cylc are available. To do this, load the rose and cylc modules in your ~/.bashrc file or simliar file.
module use /cw/keep/cawcr_share/access/modules
module load rose
module load cylc
If you don't a a ssh key on Ngamai than create a key by running the following command:
$ ssh-keygen -t rsa
The public key on ngamai needs to be sent to twister. So on ngamai run the following command.
$ ssh-copy-id [email protected]
Your environment on Ngamai also needs to be configured to ensure rose is loaded when jobs are submitted. On Ngamai you should add the rose module into your ~/.bashrc file or similar file.
module use ~access/modules
module load rose
You can check your setup is correct by running a test suite.
rosie checkout test-aa001
rose suite-run -C ~/roses/test-aa001
Periodically Rose and Cylc will be updated on Ngamai and Twister. To use the latest software versions on twister, current running suites will need to be stopped and restarted from the command prompt. If modules have been loaded via .bashrc or .bash_profile you will need to unload and reload the modules. Eg.
module unload rose
module unload cylc
module use ~access/modules
module load rose
module cylc