Sync meeting on EESSI test suite (2026 03 12) - EESSI/meetings GitHub Wiki

Meeting (2025-03-12)

Attending: Lara, Caspar, Sam

How to deal with multiple EESSI versions?

https://github.com/reframe-hpc/reframe/pull/3613 is still under discussion - but it may not happen.

Independently, we can already solve it with what is proposed in https://github.com/reframe-hpc/reframe/issues/3323 , by using the valid_sysenv_comb function. Downside is that it is not part of the public API, so no guarantee on how stable it is.

The plan for this approach would be:

  1. call valid_sysenv_comb with valid_systems = [<all_features>], and valid_prog_environs='*' and check_environs=False. This returns all partitions matching that feature
  2. Then, we check if the system returned by the regular find_modules function (as in https://github.com/casparvl/test-suite/blob/3495830864915c039681f49bab2a3c322483f6f5/eessi/testsuite/tests/apps/module_finder/module_finder2.py#L48 ) is in this list of partitions. If so, this partition has the required features, and we can simply set valid_systems = [s]. If not, we set valid_systems = [] to skip this combination.
  3. We should wrap ReFrame's find_modules function so that we can cache the results This then provides us with a way of using environments to launch tests on multiple EESSI versions with a single reframe invocation

Merged

  • add EESSIError exception to avoid printing traceback #319
  • add used_cpus_per_task parameter to allow for using fewer cores than the amount that gets allocated (e.g useful for OSU). Default is still to use all that's allocated. #322
  • Small fix so that you can load more than 1 local module (in CI/run_reframe.sh) #323
  • Fix CPU autodetection link in reported error message #324

Open

  • Loop over EESSI_VERSION to also enable testing 2025.06 by default #313
    • Should be repalced by a new PR, one that uses ReFrame environments (see discussion above => this PR can probably be closed later)
  • HCA config file #314

Action items

  • Lara:
  • Caspar:
    • Work on find-modules solution to loop over multiple EESSI envs
  • Sam:
    • Work on wrapping ReFrames find_modules function to cache the result.
    • Gromacs & Metallwals & QuantumEspresso & OSU: pull out from ReFrame hpctestlib into our own test suite.

Discussed

Should we submit something to EuroHPC User Day https://easychair.org/cfp/EuroHPCUserDays2026 ?

  • Seems to be a bit of a mismatch with the audience: test suite is not super relevant to end-users
  • Also mismatch with the format: a 10-page paper is not something we can easily write on the test suite. The work in the deliverable for WP5 could have been suitable - but that's already published there, so that can no longer be used.