Buildtest-framework

Summary of Changes
------------------------
- Fix issue with pypi package dependency in version 0.6.0

Summary of Changes
-------------------------
- option to build all software and system packages using ``--all-software`` and ``--all-package``
- option to build all yaml configuration for software and system package using ``--all-software`` and ``--all-package``
- option to run all tests for software and system package using ``--all-software`` and ``--all-package``
- rename option ``--system`` to ``--package``
- option ``--software`` and ``--package`` is consistent across build, yaml, and run subcommand
- add option ``--output`` to control output for test execution. Output can be redirected to /dev/null or /dev/stdout
- Add test count, passed and failed test after each test run when using ``_buildtest run``.
- option ``--rebuild`` and ``--overwrite`` will work with ``--all-software`` and ``--all-package`` in yaml subcommand to automate rebuilding of yaml files
- Move option `--module-naming-scheme` to build subcommand

bug fix
--------
- Fix directory issue for running buildtest first time https://github.com/HPC-buildtest/buildtest-framework/issues/81
- Fix print error https://github.com/HPC-buildtest/buildtest-framework/issues/80

=================

- Add new sub-commands ``build`` ``list`` ``run`` to buildtest
- Move the following options to ``build`` sub command
- ``-s``
- ``-t``
- ``--enable-job``
- ``--job-template``
- ``--system``
- ``--r-package-test``
- ``--python-package-test``
- ``--perl-package-test``
- ``--ruby-package-test``
- ``--shell``
- ``--ignore-easybuild``
- ``--clean-tests``
- ``--testdir``
- ``--clean-build``
- Move the following option to ``list`` sub command
- ``-ls``
- ``-lt``
- ``-svr``
- Add option ``--format`` in ``list`` sub command to view output in ``csv``, ``json``. Default is ``stdout``
- Add the following option to ``run`` sub command
- ``--app``
- ``--systempkg``
- ``--interactive`` (originally ``--runtest``)
- ``--testname``
- Added basic error handling support
- Add ``description`` key in all yaml files
- Tests have permission ``755`` so they can run automatically as any user see https://github.com/HPC-buildtest/buildtest-framework/pull/79/commits/6a2570e9d547b0fb3ab81a14770583a192092224
- Options for ``--ebyaml`` now generates date-time stamp for ``command.yaml`` see https://github.com/HPC-buildtest/buildtest-framework/pull/79/commits/a5968263e4faeac0b65386b22d9b1d5cff604185
- Add script ``check.sh`` to automate testing of buildtest features and package building for verification

Bug Fixes
- https://github.com/HPC-buildtest/buildtest-framework/pull/79/commits/8017d48c10cee706669ae5b56077640722442571
- https://github.com/HPC-buildtest/buildtest-framework/pull/79/commits/8dfe78bce930e23eb2242e4e4666f926bf60131f

buildtest 0.4.0 support by Python 3.x
----------------------------------------------------

Must use Python 3.6 or higher to use this version. All versions < 0.4.0 are supported by Python 2.

buildtest 0.3.0 release
===============

Summary of Changes
------------------------

- Package buildtest as pypi package, now it can be installed via `pip install buildtest-framework`
- Rename `buildtest` to `_buildtest` and all code is now under `buildtest`
- All buildtest repos are now packaged as pypi package and test are moved under `buildtest` directory
- The option `--ebyaml` is now working with auto-complete feature and ability to create yaml files for software packages
- Binary test are now created based on unique sha256sum see https://github.com/HPC-buildtest/buildtest-framework/commit/92c012431000ff338532a899e3b5f465f18786dd
- Output of `--scantest` has been fixed and added to documentation
- Add singularity CDASH script, need some more work on getting server setup properly



New options
--------------

- `--r-package`: build test for r packages
- `--python-package`: build test for python packages
- `--perl-package:` build test for perl packages
- `--ruby-package`: build test for ruby packages
- `--show-keys` : Display description of yaml keys

The option `--testset` is removed and will be replaced by individual option for r, perl, python, ruby package options


Bug Fixes
-----------
- Fix issue with `--runtest` option, it was broken at some point now it is working as expected
- Add extra configuration option in `config_opts` to reuse variable that were needed throughout code and fix bug with `--sysyaml` see https://github.com/HPC-buildtest/buildtest-framework/commit/493b53e4cfdb5710b384409edc7c85ceb05395ba
- Fix bug with directory not found in menu,py by moving function `check_configuration` and `override_configuration` from main.py to menu,py see https://github.com/HPC-buildtest/buildtest-framework/commit/d2c78076eb551683bf81a3a7d12ae10971460971

===============

This is a major release update on buildtest with additional options and most importantly ability to test software stack without easybuild. buildtest can be used to test multiple software trees, with ability to disable easybuild check for software stack built without easybuild. The easybuild verification in buildtest has been simplified and it can easily report which software is built by easybuild.

buildtest can report difference between 2 module trees and multiple module trees can be specified at same time for building test, and listing software, and software-version. There has been some improvement on how buildtest operates with ``Flat-Naming-Scheme (FNS)`` module naming scheme for module tree. Basically you don't need to use ``--toolchain`` option with buildtest if you are using ``FNS`` naming scheme but for ``HMNS`` module tree you will need to use ``--toolchain`` option


Summary of changes
-----------------------


* Add short option ``-mns`` for ``--module-naming-scheme`` and report total count for software, toolchain and software-version for options ``-ls``, ``-lt``, ``-svr``
* Adding options ``--clean-logs``, ``--clean-tests`` for removing directories via command line
* The file ``config.yaml`` is used to modify buildtest configuration and users can modify this to get buildtest working.
* Environment variables can override configuration in ``config.yaml`` to allow further flexibility
* add option ``--logdir`` to specify alternate path from the command line
* remove option ``--check-setup``
* buildtest can operate on multiple module trees for option ``-ls`` and ``-svr``
* rename option ``--modules-to-easyconfigs`` to ``--easyconfigs-to-moduletrees`` with a short option ``-ecmt``
* add option to show difference between module trees using ``--diff-tree``
* Fixed a bug where ``.version`` files were reported in method ``get_module_list``
* Add option ``--ignore-easybuild`` to disable easybuild check for a module tree
* rename buildtest variables in source code
* add option ``--show`` to display buildtest configuration
* add option ``--enable-job`` to enable Job integration with buildtest this is used with options ``--job-template``
* rename all sub-directories in repo ``BUILDTEST_CONFIGS_REPO`` to lowercase to allow buildtest to generate tests if software is lower case such as ``gcc`` and ``GCC`` in the module file. This enables buildtest to operate with module trees that dont follow easybuild convention
* buildtest will only generate tests for packages in python, R, ruby, perl when using ``--testset`` option if software has these packages installed. This avoids having to create excess test when they are bound to fail
* ``--testset`` option now works properly for both ``HMNS`` and ``FNS`` module naming scheme and is able to operate on modules that don't follow easybuild module naming convention