Vega - loganoz/horses3d GitHub Wiki

The modules necessary to compile and run HORSES3D are:

module load HDF5/1.13.1-gompi-2022a METIS/5.1.0-GCCcore-11.3.0
export METIS_HOME='/cvmfs/sling.si/modules/el7/software/METIS/5.1.0-GCCcore-11.3.0'
export HDF5_ROOT=$HDF5_DIR

Note: you can check the path set by the module using: env | grep -i "METIS"

Then, to compile:

make COMM=PARALLEL WITH_HDF5=YES WITH_METIS=YES MODE=HPC

An example slurm script is included below:

#!/bin/bash
#SBATCH --job-name=test         #name of the job
#SBATCH --nodes=2               #number of required nodes
#SBATCH --ntasks-per-node=128   #number of task per node
#SBATCH --cpus-per-task=1       #number of cpus per task
#SBATCH --hint=nomultithread    #disable multithread, means that the job used physical cores
#SBATCH --partition=cpu         #partition name
#SBATCH --output=foo-out.%j     #outout file from the job
#SBATCH --error=foo-err.%j      #error file from the job
#SBATCH --time=48:00:00         #executing time
 
export OMP_SCHEDULE="guided"
export OMP_NUM_THREADS=$SLURM_CPUS_PER_TASK
 
module purge
module load HDF5/1.13.1-gompi-2022a METIS/5.1.0-GCCcore-11.3.0
export METIS_HOME=$METISROOT
export HDF5_ROOT=$HDF5_DIR
 
echo "##########################################################################"
echo "#"
echo "# Running with $SLURM_NTASKS tasks and $SLURM_CPUS_PER_TASK cpus/task"
echo "# On nodes $SLURM_JOB_NODELIST"
echo "#"
echo "##########################################################################"
 
EXEC=../../../bin/horses3d.ns
 
srun $EXEC NACA0012.control