Eessi-testsuite

This is a minor release of the EESSI test-suite.

WARNING: this release contains a breaking change ([258](https://github.com/EESSI/test-suite/pull/258)) for the format of the required ReFrame configuration file. Essentially, this requires making the following substitutions in the ReFrame configuration file.

* `FEATURES[CPU]` => `FEATURES.CPU`
* `FEATURES[GPU]` => `FEATURES.GPU`
* `'mem_per_node'` => `EXTRAS.MEM_PER_NODE`
* `DEVICE_TYPES[CPU]` => `DEVICE_TYPES.CPU`
* `DEVICE_TYPES[GPU]` => `DEVICE_TYPES.GPU`
* `GPU_VENDOR: GPU_VENDORS[NVIDIA]` => `EXTRAS.GPU_VENDOR: GPU_VENDORS.NVIDIA`
* `FEATURES[ALWAYS_REQUEST_GPUS]` => `FEATURES.ALWAYS_REQUEST_GPUS`

See the [updated documentation](https://www.eessi.io/docs/test-suite/ReFrame-configuration-file/) for more details.

Updates:

* Use NamedTuples to define constants instead of constants indexing a dictionary of constants [258](https://github.com/EESSI/test-suite/pull/258)

This is a bug fix release of the EESSI test-suite

Bug fix:

* Add exact_memory attribute to tests that are not inheriting from EESSI_Mixin to avoid '<testname>' object has no attribute 'exact_memory' failure [245](https://github.com/EESSI/test-suite/pull/245), fixes [#252](https://github.com/EESSI/test-suite/issues/252)

Other updates:

* Prefix mixin method names to avoid accidental overrides [246](https://github.com/EESSI/test-suite/pull/246)
* Use CI constant (instead of 'CI' as string) [247](https://github.com/EESSI/test-suite/pull/247)
* Ported ESPResSo to EESSI_Mixin [248](https://github.com/EESSI/test-suite/pull/248)
* Simplify `executable_opts` with new variable `user_executable_opts` [249](https://github.com/EESSI/test-suite/pull/249)
* Update example_settings.py config file [254](https://github.com/EESSI/test-suite/pull/254)

This is a bug fix release of the EESSI test-suite

Other updates:
* Update to release workflow instructions (232)
* Document how to use a different version of the config files when using `CI/run_reframe.sh` (235)
* Bump the use of the default ReFrame version for period tests that use `CI/run_reframe.sh` to ReFrame 4.7.3 (236)
* Make `CI/run_reframe.sh` use the latest release of the test suite as default version (237)

--------------------------

This is a minor release of the EESSI test-suite

New tests:

* MetalWalls (164) (N.B. requires ReFrame >=4.7.0)

New features:
* Created `eessi_mixin` class for tests to inherit from. This class makes it easier to create portable tests, and also keeps the structure of those tests more uniform. (177)
* Automatic versioning with setuptools_scm (185)
* Ported tests to use the eessi_mixin class: CP2K (193), MPI4py (203), QuantumESPRESSO (212), PyTorch (213), TensorFlow (221), OSU (222)
* Improved support for doing periodic test suite runs on a local software stack using `CI/run_reframe.sh` (200)
* Support for setting the exact required memory (214)
* For periodic tests using `CI/run_reframe.sh`, allow using a different version of the test-suite repository for the ReFrame config files (226)

Bug fixes:
* Fixed failing `mktemp` command in `CI/run_reframe.sh` when EESSI_CI_TEMPROOT isn't set (227)
* Make tests that _don't_ use `eessi_mixin` always request GPUs if this is specified in the test.

Other updates:
* Update lammps hook name to be more descriptive (177)
* Add empty __init__ files to allow auto-generating API docs (192)
* Updates to ReFrame configs (195, 198, 199, 202, 215, 216, 223, 225)
* Log if the CI tag gets set (204)
* Reduce the amount of data that gets copied during ReFrame staging (205, 220)
* Log CVMFS_REPO_NAME, CVMFS_SOFTWARE_SUBDIR, MODULEPATH and EESSI test-suite version (206)
* Clarify error messages from EESSI mixin that warn test developers if certain variables aren't set on time in the child class (208)
* For periodic tests using `CI/run_reframe.sh`, avoid cloning the full history (218)
* Update release instructions (230)

Release date: 26 September 2024
--------------------------

This is a minor release of the EESSI test-suite

New tests:

* PyTorch (with torchvision) (130)
* LAMMPS (131, 169)
* CP2K (133)

Bug fixes:
* Find and report duplicate modules (167)
* Specify memory as an extra resource in all ReFrame configs (180)
* Make req_memory_per_node hook print a warning if memory resource is not configured in ReFrame config (182)
* No longer test import of eessi.testsuite.utils directly in CI, as it fails (by design) for the ReFrame 4.6.2 version deployed in EESSI (183)

Other updates:
* mpi4py reduction test for tutorial (149, 172), to accompany [documentation](https://www.eessi.io/docs/test-suite/writing-portable-tests/) on writing portable tests for the EESSI test suite
* Various updates to Snellius ReFrame config (165, 168, 187, 188)
* Make the use of EESSI optional in common_eessi_init, to better support testing of local software stacks (166)
* Remove hard-coded SLURM account from karolina and hortense configs in favour of using the `$SBATCH_ACCOUNT` environment variable (171)
* Add ReFrame config and CI config for EESSI Azure build cluster (173, 176, 186)
* Add hook for measuring memory usage in a job (174)
* Bump default ReFrame version used in CI config to 4.6.2 (175)
* Use ReFrame warning's to print warnings, amking them easier to spot (178)
* Limit runtime of ReFrame command in in CI config (179)
* Add release notes and bump versions (189)

Release date: 29 June 2024
---------------------

This is a bugfix release of the EESSI test-suite


What's Changed

* Add config for Deucalion (162)


**Full Changelog**: https://github.com/EESSI/test-suite/compare/v0.3.1...v0.3.2