Reframe-hpc

ReFrame v3.4.2 Release Notes

New features and enhancements

- Add built-ins to manage test variables and parameters (1699)
- Allow logging arbitrary job attributes (1788)
- Comply with the semantic versioning specification (1761)

Bug fixes

- Print a FAILURE result if not all test cases have completed (1801)
- Document `osext.cray_cdt_version()` more precisely (1796)
- Fix `AttributeError` crash when handling OS errors while writing a test case file (1785)
- Move shell completion scripts under `share/completions/` (1787)
- Add Python version check to bootstrap script (1762)
- Various documentation fixes (1771, 1798)
- Add missing required packages in 'setup.py' (1767)
- Fix validation of the generated Gitlab pipeline files (1764)

ReFrame v3.4.1 Release Notes

New features and enhancements

- Add new action for generating dynamic Gitlab pipelines (1641)
- Add auto completion support to ReFrame (1685)
- Add a new family of sanity functions that looks for patterns inside text instead of files (1705)
- Support multiple job submissions when slurm's job submit limit is reached (1704)
- Add `--maxfail` option to stop execution after a certain number of failures (1676)
- Set executable bit in generated job script files (1716)

Bug fixes

- Fix skipping of test cases in case of unresolved dependencies (1751)
- Fix "New in version" annotation in documentation for certain new features (1754)
- Fix parameter value specification in the `parameter()` directive (1722)
- Fix handling of single character scheduler backend options passed through `-J` (1718)

ReFrame v3.4 Release Notes

New features and enhancements

- Add sanity function equivalents of some of `os.path` functions (1695)
- Introduce new syntax for allowing the creation of extensible parametrised tests (1614)
- Support CUDA Fortran file extensions in SingleSource (1677)
- Support `spack load` for loading software packages (1624)
- Remove the --use-feature=2020-resolver from bootstrap (1652)
- Add ability to restore a test session and rerun selected tests (1538)
- Drop support of pipeline stage method override (1636)
- Drop support for old configuration syntax (1630)
- Allow using colon separated paths with the `--module-path` option (1623)
- Remove deprecated `pre_run`, `post_run`, `prebuild_cmd` and `postbuild_cmd` attributes (1625)

Bug fixes

- Skip test cases recursively in case of dangling dependencies (1714)
- Correct the advisory rerun message on test failures (1706)
- Ensure that job options passed from the command-line are always the last in the generated job script (1701)
- Fix sanity function `print` to accept a single object only (1698)
- Fix numbering of failed tasks when reframe execution is aborted (1673)
- Revert feature to preserve symbolic links in sources directory since it can lead to dangling links in the stage directory; users should use `readonly_files` instead (1670)
- Fix documentation of sanity functions accepting a filename (1666)
- Do not evaluate deferred expressions when dumping in JSON (1665)
- Pass the job id when raising job-related errors (1662)
- Restore module paths specified in command line when restoring module collections (1656)
- Properly expand environment variables for the filelog log handler (1659)
- Fix module backend implementation for Lmod versions < 8.2 (1654)
- Fix formatting of lists of non-string objects when logging (1649)
- Send test attributes correctly with the Graylog handler (1644)
- Fix detailed listing message for node allocation scheme (1637)
- Fail properly when the source code language cannot be guessed (1619)

ReFrame v3.3 Release Notes

New features and enhancements

- Add command-line option to manipulate the module path before executing any tests (1606)
- Allow any test attribute to be logged (1600)
- Add support for building tests remotely (1591)
- Print test dependencies in failure report (1601)
- Add possibility to inherit the prefix from the parent class (1570)
- Validate tests after loading them (1599)
- Make test filtering aware of test dependencies and simply skip the tests in case of unresolved dependencies (1594)
- Add support for module collections (1586)
- Print more information about dependencies in detailed test listing (1576)
- Preserve symbolic links in sources directory (1580)
- Better logging of framework activities, especially test loading (1571)
- Allow dependencies between partitions (1481)
- Accept file glob patterns in `keep_files` (1562)
- Control verbosity of check failure info (1552)
- Color deprecation warnings (1549)
- Add option to install pygelf in boostrap script (1529)
- Set the default location for log files to be the system's temporary directory (1531)

Bug fixes

- Treat conflicts in module mappings properly (1611)
- List inherited pipeline hooks with the `-L` option (1597)
- Properly define default values for the 'modules' and 'variables' configuration parameters of the 'container_platforms' (1608)
- Fix regression when filtering with multiple criteria (1603)
- Remove duplicate entries in test listing (1593)
- Fix unit test error due the PID 1 problem when running inside a Docker container (1583)
- Fix handling of symbolic links in `osext.copytree()` when destination exists (1575)
- Fix spacing issues when defining options for execution modes (1556)
- Fix statistics crash when reporting task dependency errors (1564)
- Add newline at the end of run report (1561)
- Fix `IndexError` crash of `osext.copytree()` when the source directory does not exist (1548)
- Fix bug when patchlevel in environment modules version is not an integer (1540)