Supported Hardware and Software - crt26/pqc-evaluation-tools GitHub Wiki

Supported Hardware and Operating Systems

This page outlines the hardware and software the project currently supports.

The automated testing tool is currently only supported to run in the following environments:

  • x86 Linux Machines using a Debian-based operating system
  • ARM Linux devices using a 64-bit Debian based Operating System
  • Windows systems, if used only for parsing raw performance results

Tested Dependency Libraries

This version of the repository has been fully tested with the following library versions:

  • Liboqs Version 0.13.0

  • OQS Provider Version 0.8.0

  • OpenSSL Version 3.4.1

The repository is configured to pull the latest versions of the OQS projects while maintaining the listed OpenSSL version. This ensures support for the most up-to-date algorithms available from the OQS project. The setup process includes handling changes in the OQS libraries and helping maintain compatibility as updates are released.

However, as the OQS libraries are still developing projects, if any major changes have occurred to their code bases, this project's automation scripts may not be able to accommodate this. If this does happen, please report an issue to this repositories GitHub page where it will be addressed as soon as possible. In the meantime, it is possible to change the versions of the OQS libraries used by the benchmarking suite. This is detailed further in the Installation Instructions section.

Notice 1: The HQC KEM algorithms are disabled by default in recent Liboqs versions due to a disclosed IND-CCA2 vulnerability. For benchmarking purposes, the setup process includes an optional flag to enable HQC, accompanied by a user confirmation prompt and warning. For instructions on enabling HQC, see the Advanced Setup Configuration Guide, and refer to the Disclaimer Page for more information on this issue.

Notice 2: Memory profiling for Falcon algorithm variants is currently non-functional on ARM systems due to issues with the scheme and the Valgrind Massif tool. Please see the bug report for details. Testing and parsing remain fully functional for all other algorithms.