Sync meeting on EESSI test suite (2026 02 12) - EESSI/meetings GitHub Wiki

Meeting (2025-02-12)

Attending: Lara, Caspar, Sam, Satish

How to deal with multiple EESSI versions?

As discussed last time, several options were discussed. Best seem to be:

  1. If https://github.com/reframe-hpc/reframe/pull/3613 gets accepted, we can set valid_systems = module_info[0] (other features will be appended, and respected because of the PR)
  2. Add partition name as requested feature, and set valid_systems = f"+{module_info[0]}"" => Tested by Caspar on 10-02-2026 using a dummy test, works fine

As Sam commented on Slack, to keep choice of using our own find_modules is orthogonal to this: we can invoke the upstream find_modules from our own, and keep logic to do name_only and caching. Return type would have to change to a (Named?)Tuple, similar to the upstream one, because we then need to set the valid_systems and valid_prog_environs in a hook.

Merged

  • use RegressionTestPlugin instead of RegressionMixin #315 => Required to fix deprecation message #299
  • update Hortense config #316
  • Fix broken all_readonly_files due to recent change in ReFrame #318
  • Check process binding: #312
    • Discussed: it currently does not make the test fail. This may be hard to detect if e.g. we're only looking at the dashboard. Probably better to make the test fail, and to make that failure conditional (i.e. if -S is set, turn any errors related to binding into a warning) => Sam will create a follow-up PR for this.

Open

  • Loop over EESSI_VERSION to also enable testing 2025.06 by default #313
    • Should be repalced by a new PR, one that uses ReFrame environments (see discussion above)
  • Add EESSIError exception to avoid printing traceback #319
    • Caspar: is this helpful? To me, it provides a starting point if I want to e.g. add support for a new value that should be allowed (or something similar)
    • An error popped up in the CI of this PR because of deprecation of pkg_resources. Short term fix is implemented in this PR, long term, we should switch to importlib. See https://github.com/EESSI/test-suite/pull/319

Action items

⚠️ **GitHub.com Fallback** ⚠️