Reframe-hpc

ReFrame v3.2 Release Notes

New features and enhancements

- Delay the setup of performance logging, so that `perf_patterns` can be defined after the test construction (1509)
- Redesign job polling mechanism in the framework (1402)
- Add configuration parameter for automatically capturing command errors and exit code in job scripts (1490)
- Add utility function to look for available environment modules (1417)
- Drop support of scheduler-specific command-line options (1483)
- Change default JSON report file pattern (1480)
- Drop tuple syntax for timer fields (1470)
- Allow disabling pipeline hooks from the command line (1462)

Bug fixes

- Fix typo in modules system unit tests (1517)
- Fix error message when a sane Tmod installation cannot be found (1510)
- Treat correctly forced local jobs and other small fixes (1513)
- Do not require a configuration to be resolved always at system level (1508)
- Print current environment and partition correctly even if a test fails before the setup (1506)
- Add `importlib_metadata` to requirements (1503)
- Load configuration even if the username cannot be retrieved (1499)
- Restore environment correctly in case of module load failures (1501)
- Fix bootstrap script for Ubuntu/Debian installation (1493)
- Remove unnecessary error message from failure report (1491)
- Fix JSON report generation for deferred expressions (1489)
- Fix module import for files under `site-packages` (1488)
- Fix formatting of summary listing of checks (1475)
- Fix crash when git is not available (1472)
- Fix `OrderedSet` implementation (1468)
- Use new the 2020 pip dependency resolver in the bootstrap script (1461)
- Add always units in the default reference tuple (1460)
- Fix parsing of multiline `exec_host` in `qstat` output (1457)
- Fix glob pattern to search for both txt and yaml (1439)
- Fix JSON schema $id parameter (1438)

Other

- Remove the unit tests from the coverage report (1518)
- Set save location for JSON report files for CSCS (1471)

ReFrame 3.1 Release Notes

New features and enhancements

- Support multiple tags in `extract*` sanity functions (1433)
- Produce detailed JSON report for a regression testing session (1377)
- Increase default concurrency of asynchronous execution policy to 8 jobs (1428)
- Allow Syslog's address to be set from an environment variable (1427)
- Add utility function for retrieving Cray Linux Environment (CLE) information (1419)
- Add utility function for retrieving the current Cray CDT version (1416)
- Add option to disable test stage directory cleanup (1404)
- Allow flexible node allocation to select nodes in any state (1374)
- Add bootstrap script to install dependencies of ReFrame (1371)

Bug fixes

- Capture all pending test tasks in the exit loop of the asynchronous execution policy (1434)
- Convert Syslog handler port parameter into integer (1424)
- Use '&' to combine Slurm constraints (1423)
- Fix unit test failure of asynchronous execution policy (1411)
- Copy scheduler options when initializing job instances (1413)
- Normalize ReFrame path prefixes (1400)
- Process execution modes before configuring logging (1399)
- Add missing launchers `upcrun` and `upcxx-run` in configuration schema (1393)
- Combine access and job options for slurm '--constraint' (1363)
- Fix AttributeError when pipeline hooks are defined in a mixin class (1373)

Regression tests

- TrilinosTest_static build workaround for cdt/20.06 (1403)
- Workaround for NetCDF tests for CDT20.06 (1426)
- Enhance workaround for PGI in CDT 20.06 (1421)
- Add account in executable options of RequiredConstraintCheck (1407)
- Update configuration and tests for MCH system (1384)
- PrgEnv-pgi workaround for CDT 20.06 (1389)
- Fix deprecation warning in IPCMagicCheck (1387)
- Remove PrgEnv-cray_classic from Dom and add it to Daint (1388)
- Update P2P test on Dom (1385)
- Add check for IPCMagic (1360)
- Exclude Slurm memory overconsumption test from Tsa (1364)
- New Slurm setup for Cp2kGpuCheck (1304)

Other

- Revert dom config to TMod modules system (1435)
- Change modules system for Dom to TMod4 (1431)
- Dynamically set the account in CSCS config (1418)
- Set the account dynamically in the configuration file for unit tests (1409)
- Use account option in CSCS CI (1405)
- Use eb 3.1-dev0 recipe as template for deployment (1396)
- Document that sanity functions use 're.MULTILINE' (1425)
- Renew the tutorials (1397)
- Expand documentation of `require_deps` decorator (1401)
- Create man pages in proper man subdirectories (1386)