Pasha's notes - openucx/ucx GitHub Wiki

uct_release_resource_list (src/uct/tl/context.c +137):

  • The code was changed to return void instead of status
  • Do we what to make it TL specific ?

ucs_status_t (*query_resources)(uct_context_h context, uct_resource_desc_t **resources_p, unsigned *num_resources_p);

  • API was changed ! unsigned flags was removed from the parameter list.
module swap PrgEnv-pgi PrgEnv-gnu
module load boost/1.54.0
module swap PrgEnv-gnu PrgEnv-pgi
  • Librte configure on cray
/ccs/home/pavel/work/librte/configure --prefix=/lustre/atlas/scratch/pavel/stf010/install --with-pmi=/opt/cray/pmi/default/ --with-pmi-lib=/opt/cray/pmi/default/lib64/ --with-pmi-include=/opt/cray/pmi/default/include/
  • UCX configure on cray
/ccs/home/pavel/work/ucx/configure --prefix=/lustre/atlas/scratch/pavel/stf010/install --enable-gtest --enable-instrumentation --enable-frame-pointer --enable-stats --enable-memtrack --enable-fault-injection --enable-debug-data --without-verbs --enable-gtest=/lustre/atlas/scratch/pavel/stf010/gtest-1.7.0/ --with-rte=/lustre/atlas/scratch/pavel/stf010/install

make -C test/gtest test LAUNCHER="aprun -n 1 -cc none" UCS_HANDLE_ERRORS="debug"

Running on regular IB machine

make -C test/gtest test


== topics to discuss 
* ucs_ names in UCP space ucs_status_t, ucs_config_print_flags_t
* ucp_worker_proto_print - bad name
* ucp_ep_fence ? 
* ucp_atomic_swap64/cswap  - should be replaced with non-blocking
* remove blocking put/get