Conference call notes 20221123 - easybuilders/easybuild GitHub Wiki

(back to Conference calls)

Notes on the 210th EasyBuild conference call, Wednesday 23 November 2022 (16:00 UTC)

Attendees

List of attendees (19):

  • Sebastian Achilles (J ülich Supercomputing Centre, Germany)
  • Maxime Boissonneault (Digital Research Alliance of Canada)
  • Simon Branford (Univ. of Birmingham, UK)
  • Jordi Camps (CNAG-CRG, Spain)
  • John Dey (Fred Hutch, Seattle, US)
  • Alex Domingo (Vrije Universiteit Brussel, Belgium)
  • Em Dragowsky (Case Western Reserve University, Ohio, US)
  • Fotis Georgatos (EPFL, Switzerland)
  • Jasper Grimm (University of York, UK)
  • Thomas Hayward-Schneider (Max Planck Institute for Plasma Physics, Germany)
  • Kenneth Hoste (HPC-UGent)
  • Adam Huffman (Big Data Institute, Oxford, UK)
  • Sebastien Moretti (SIB, Switzerland)
  • Alan O'Cais (CECAM, Switzerland)
  • Mikael Öhman (Chalmers University of Technology, Sweden)
  • Bart Oldeman (Digital Research Alliance of Canada)
  • Umashankar Sivakumar (AMD)
  • Caspar van Leeuwen (SURF, Netherlands)
  • Lars Viklund (Umeå University, Sweden)

Agenda

  • overview of recent developments + outlook to next EasyBuild release
  • update on porting of EasyBuild docs to MarkDown
  • 2022b common toolchain
  • Q&A

Recent developments

  • release timeline
    • latest release: EasyBuild v4.6.2 (21 Oct 2022)
    • ETA next release (EasyBuild v4.7.0): by mid Dec'22
  • recent changes
    • framework
      • bug fixes
        • fix build options that should have empty list as default value (PR #4108)
        • catch easyconfig parsing failure so we can generate and post a test report (PR #4109)
        • add explicit return when no checksums match those specified in a tuple (PR #4112)
      • enhancements
        • add support for checksums specified in external checksums.json file (PR #3749)
          • should we adopt the use of this in the central easyconfigs repo?
          • complications:
            • dealing with merge conflicts in easyconfig PRs...
            • --new-pr and/or --merge-pr would need to be made a bit more intelligent
            • Bart: there's some analogy with Gentoo manifest files here
          • --new-pr should also have support for including a checksums.json into a PR
        • take into account custom configuration options specified in easystack file (PR #4057)
      • changes
        • drop support for easystack files using 'software' top-level key (PR #4057)
    • easyblocks
      • bug fixes
        • ...
      • enhancements
        • add extra option in ESMF easyblock for disabling LAPACK (PR #2821)
      • updates
        • update Clang easyblock to add support for new directory structure in Clang versions >= 14 (PR #2800)
        • update Xmipp easyblock to handle effects of CUDA at SYSTEM level and newer CUDA version requirements for stdc++ (PR #)
      • changes
        • ...
      • new software
        • add generic JuliaPackage easyblock (PR #2816)
          • used for:
          • from-source Julia build is still to be done...
    • easyconfigs
  • work in progress
    • framework
      • reported bugs / bug fixes
        • sanity_check_rpath should not check for libcuda.so.1 (PR #4095)
      • enhancements
        • add easybuild.tools.LooseVersion (since distutils is deprecated in Python 3.10) (PR #3794)
        • add support for AOCC compiler + AMD FFTW library and definitions for amd, aocc, aompi toolchains (PR #4058)
        • add Arch Linux compatibility for OS dependency resolution (PR #4116)
        • add support for --filter-rpath-sanity-libs to skip RPATH sanity check for designated libraries (PR #4119)
        • add sanity_check_load_module method to EasyBlock to provide control over when module is loaded during sanity check step (PR #4125)
        • verify that the compilers supposed to be used actually work (issue #4124)
      • changes
        • also run unit tests with Python 3.11 (WIP) (PR #4092)
    • easyblocks
      • bug reports/fixes
        • create $XDG_CACHE_HOME for PyTorch tests (PR #2806)
        • load module early during PythonPackage's sanity check step via sanity_check_load_module (PR #2828)
          • to fix --sanity-check-only not working for software installed with PythonPackage (see issue #2745)
        • tweak version regex in OpenSSL easyblock for compatiblity with Arch Linux (PR #2829)
      • enhancements
        • refusing to build binutils when the system version is newer (issue #2817)
      • updates
        • update version of config.guess used by ConfigureMake (issue #2826)
        • update LLVM easyblock to put 'cmake' symlink in place so separate CMake modules requires for LLVM 15+ can be found (PR #2832)
      • new software
        • add generic JuliaBundle easyblock (PR #2830)
      • changes
        • ...
    • easyconfigs

Update on porting of EasyBuild docs to MarkDown

2022b common toolchains

  • proposal for foss/2022b
    • see foss/2022.10
    • GCC 12.2.0 + binutils 2.39 (current latest)
    • UCX 1.13.1 + libfabric 1.16.1 + OpenMPI v4.1.4 (current latest) - same as in foss/2022a
    • OpenBLAS 0.3.21 + FlexiBLAS 3.2.1 (current latest)
    • FFTW 3.3.10 (current latest) - same as in foss/2022a
    • ScaLAPACK 2.2.0 (current latest) - same as in foss/2022a
  • proposal for intel/2022b:
  • key software

Q&A

  • Mikael: working on framework PR for NVHPC-based full toolchain (incl. FlexiBLAS + OpenMPI)