How to set RP on TITAN - ATLAS-Titan/misc GitHub Wiki

Overview

This tutorial aims to provide a 5 minute introduction to RADICAL-Pilot and its ability to execute multiple concurrent simulations on TITAN. Here we use GROMACS -- a commonly used MD kernel as an example, but also provide an example for a simple "executable" /bin/date.

How to set Radical Pilot on ORNL's TITAN

Setting of Environment Variables

export LD_PRELOAD=/lib64/librt.so.1

MongoDB URL

export RADICAL_PILOT_DBURL=mongodb://144.76.72.175/alessio

Please note that this database url is available for small tests. Use your own database for large experimental campaigns

Module Loading for the creation of the virtualenv

module load python

module load python_setuptools

module load python_virtualenv

module load python_pip

Download from git hub

git clone https://github.com/radical-cybertools/radical.pilot branch: devel

git clone https://github.com/radical-cybertools/radical.utils branch: devel

git clone https://github.com/radical-cybertools/saga-python branch: devel

Creation of the virtualenv

virtualenv <name>

Activate the virtualenv

source <name>/bin/activate

Installation of all the requirements in the virtualenv (Assuming radical-utils, saga-python and radical-pilot in the same directory)

pip install radical-utils/ saga-python/ radical-pilot/

Run an example (Gromacs simulation)

The example consider a single thread gromacs simulation as a CU. The number of CUs and the number of cores can be set by the user. If the user does not set the parameters, the script runs 128 CUs on 128 cores by default.

Download of the example

git clone https://github.com/ATLAS-Titan/misc/

cd misc/fireworks

Test if gromacs is accessible

Try to reach the executable at:

/lustre/atlas/scratch/aleang9/csc108/gromacs/bin/gmx_mpi

If the executable is not accessible then change the path at line 5 in CUDef.py

Note that an Open-MPI version of gromacs must be used. Cray-MPI is not orte compatible. Thus, the module available on TITAN cannot be used

To compile your own Open-MPI gromacs follow this link

Note that by switching the comment between lines 95 and 96, it is also possible to run /bin/date

Example

Execute gromacs simulation

DO NOT comment this line line

Comment this line line

Execute /bin/date

Comment this line line

DO NOT comment this line line

Run the example (with the virtualenv active)

python example.py <# gromacs simulations> <# cores of the pilot>

To know more about Radical Pilot:

Documentation

⚠️ **GitHub.com Fallback** ⚠️