Reframe-hpc

ReFrame 2.11 Release Notes

API Changes

None

Framework

- New feature: support for module mappings
- Submit jobs from the stage directory
- Allow thresholds >= 1.0 in `assert_reference()` sanity function
- Flexible allocation take into account the `--exclude-nodes` option
- Add prefix `rfm_` to the job names of ReFrame tests
- Fix crash when an unknown modules system is set in the configuration
- Fix and update documentation on the `check_info` logging attribute
- Fix math domain error in the polling function of the asynchronous execution policy
- Fix failure of the asynchronous execution policy's unit tests
- Fix confusing error messages in serial execution policy
- Fix emission of Slurm's `--exclusive` flag
- Fix logging configuration in generic settings

Regression tests

- Add regression tests for GPU direct
- Add a G2G meteoswiss regression test
- Add ICON RRTMGP regression test
- Add numerical sanity check in quantum espresso test
- Enable the `switches` resource certain tests
- Fix deprecation warnings in regression tests

ReFrame 2.10 Release Notes

API Changes

* `RegressionTest.sourcesdir` is now always copied to the stage directory
* Support for specifying Git repositories in `RegressionTest.sourcesdir`
* `Job.pre_run` and `Job.post_run` fields are deprecated in favour of the new ones `RegressionTest.pre_run` and `RegressionTest.post_run`


Framework

* Support for the LMod modules system
* Support for module aliases by the internal modules system abstraction
* New more robust design of the regression test execution policies
* More robust and efficient error checking for the Tmod modules system backend
* Fix framework behaviour when trying to run interactive commands
* Fir random unit tests failures with Python 3.5
* Documentation fixes

ReFrame 2.9 Release Notes

API Changes

* Old sanity and performance patterns syntax completely removed
* New extended syntax of `extra_resources`
* Allow `sourcesdir` to be `None` even for compiled regression tests
* More advanced examples in documentation

Framework

* Redesign of the exception hierarchy
* Version information moved away from settings
* Support for flexible job allocations that span a full reservation
* Support for easy deprecation of fields
* Fix ungraceful exit when a job is blocked in in unrecoverable state
* Fix regex group references to be compatible with Python 3.5
* Fix random failures in unit tests
* Fix behaviour of `--partition` option to override any similar option passed in site configuration

ReFrame 2.8.1 Release Notes

API Changes

None.

Framework

- Suppress SKIP messages in the output
- Support of an squeue-only Slurm backend
- ReFrame version is now printed in the performance logs
- New sanity function wrappers for `itertools.chain()`, `glob.glob()` and `glob.iglob()` functions
- Sanity functions reading files now accept an encoding option
- Fix typos in documentation
- Fix broken images in documentation

ReFrame 2.8 Release Notes

API Changes

- New `RegressionTest` attribute, `extra_resources`, for specifying custom job resources
- New API for retrieving and setting the parallel program launchers
- New API for retrieving the job scheduler of a system partition

Framework

- Redesign of the modules system backend
- Tmod is no more required to run ReFrame
- New system configuration option for setting the modules system
- More detailed output in the performance log
- Redesign of the job scheduler and parallel program launcher backends
- Expand support of several new parallel program launchers (`mpirun`, `mpiexec` etc.)
- Documentation fixes

ReFrame 2.7 Release Notes

API Changes

- New composable and flexible syntax for sanity and performance checking
- Old syntax of `RegressionTest.sanity_patterns` and `RegressionTest.perf_patterns` is deprecated
- `RegressionTest.strict_check` attribute behavior changed

Framework

- New complete documentation with tutorial and reference guides
- New command-line option `--strict`
- New syntax in the configuration file
- New `resourcesdir` entry in the systems section of the configuration file
- Removed command-line option `--relax-performance-check`
- More robust unit tests of the asynchronous execution policy
- `prefix_apps` was removed from the settings.
- Standardised the behaviour of scoped dictionaries
- Code quality improvements
- Fixed misleading failure reports in asynchronous execution policy
- Fixed behaviour of the `--nocolor` option
- Fixed frontend crash during failure report when a test fails early in its setup phase
- Fixed crash when using execution modes