Conference call notes 20221207 - easybuilders/easybuild GitHub Wiki

(back to Conference calls)

Notes on the 211th EasyBuild conference call, Wednesday 7 December 2022 (09:00 UTC)

Attendees

List of attendees (11):

  • Simon Branford (Univ. of Birmingham, UK)
  • Alex Domingo (Vrije Universiteit Brussel, Belgium)
  • Jasper Grimm (University of York, UK)
  • Kenneth Hoste (HPC-UGent)
  • Alain van Hoof (TU Eindhoven, Netherlands)
  • Lev Lafayette (Univ. of Melbourne, Australia)
  • Sebastien Moretti (SIB, Switzerland)
  • Jurij Pečar (EMBL, Germany)
  • Åke Sandgren (Umeå University, Sweden)
  • Jörg Saßmannshausen (Imperial College London, UK)
  • Abdoul Wahid Mainassara (LuxProvide, Luxembourg)

Agenda

  • overview of recent developments + outlook to next EasyBuild release
  • update on porting of EasyBuild docs to MarkDown
  • 2022b update for common toolchains
  • Q&A

Recent developments

  • release timeline
    • latest release: EasyBuild v4.6.2 (21 Oct 2022)
    • ETA next release (EasyBuild v4.7.0): by mid Dec'22
  • recent changes
    • framework
      • bug fixes
        • ...
      • enhancements
        • check whether nvidia-smi/rocm-smi command is available before trying to run it in get_gpu_info (PR #4131)
        • automatically cancel Github Action workflow runs for outdated commits (PR #4132)
      • changes
        • ...
      • docs
        • correct uses of :param name: and :return: in docstrings (PR #4129)
        • docstrings - fixes to formatting or variables names (PR #4130)
    • easyblocks
      • bug fixes
        • create $XDG_CACHE_HOME for PyTorch tests (PR #2806)
        • fix counting of failures in PyTorch tests (PR #2834)
        • fix Python 2.7 compatibility of PyTorch easyblock (PR #2840)
      • enhancements
        • automatically cancel Github Action workflow runs for outdated commits (PR #2835)
        • use fixed names for bazel/wrapper subdirectories used when building TensorFlow, to make debugging easier (PR #2841)
      • updates
        • update Xmipp easyblock to handle effects of CUDA at SYSTEM level and newer CUDA version requirements for stdc++ (PR #2831)
        • update LLVM easyblock to put 'cmake' symlink in place so separate CMake modules requires for LLVM 15+ can be found (PR #2832)
      • changes
        • ...
      • new software
        • add generic JuliaBundle easyblock (PR #2830)
    • easyconfigs
  • work in progress
    • framework
      • reported bugs / bug fixes
        • ...
      • enhancements
        • add easybuild.tools.LooseVersion (since distutils is deprecated in Python 3.10) (PR #3794)
        • add support for using --output-format=md (MarkDown) (PR #4117)
        • add support for --filter-rpath-sanity-libs to skip RPATH sanity check for designated libraries (PR #4119)
        • add sanity_check_load_module method to EasyBlock to provide control over when module is loaded during sanity check step (PR #4125)
        • add checksums.json support for Github integration (PR #4133)
      • changes
        • also run unit tests with Python 3.11 (WIP) (PR #4092)
        • auto-enable use of oneAPI C/C++ compilers for intel-compilers >= 2022.2.0 (PR #4135)
        • deprecate support for running EasyBuild with Python 2 (PR #4136)
    • easyblocks
      • bug reports/fixes
        • load module early during PythonPackage's sanity check step via sanity_check_load_module (PR #2828)
          • to fix --sanity-check-only not working for software installed with PythonPackage (see issue #2745)
      • enhancements
        • set $TEMPDIRPATH for testsuite in the BerkeleyGW easyblock, to avoid polluting /tmp (PR #2836)
        • allow use of test_cmd without runtest for ConfigureMake (PR #2837)
        • enhance CMakeMake easyblock to run ctest command if runtest is True (PR #2838)
      • updates
        • ...
      • new software
        • ...
      • changes
        • ...
    • easyconfigs

Update on porting of EasyBuild docs to MarkDown

2022b common toolchains

  • proposal for foss/2022b
    • see foss/2022.10
    • GCC 12.2.0 + binutils 2.39 (current latest)
    • UCX 1.13.1 + libfabric 1.16.1 + OpenMPI v4.1.4 (current latest) - same as in foss/2022a
    • OpenBLAS 0.3.21 + FlexiBLAS 3.2.1 (current latest)
    • FFTW 3.3.10 (current latest) - same as in foss/2022a
    • ScaLAPACK 2.2.0 (current latest) - same as in foss/2022a
  • proposal for intel/2022b:
  • key software
    • Perl 5.36.0 (done, see PR #16204)
    • Python 3.10.8 (done, see PR #16632)
    • X11 v20221110 (done, see PR #16664)
    • Qt5 v5.15.7 with GCCcore/12.2.0 (PR #16810)
      • PRs for required dependencies are still missing
      • What do we do with JasPer? Use v4.0.0? Use latest v3.x?
        • need to keep an eye on grib (for WRF), ...
  • mpi4py should be split off from SciPy-bundle

Q&A

  • Jörg: support for IPUs in EasyBuild
    • we can set up a meeting to discuss how support for IPUs can be implemented in EasyBuild
  • software pulling in lots of dependencies automatically