Mrack

New features:

Create CODE_OF_CONDUCT.md
Add basic image validation to AWS and Beaker
Support restraint_id record in metadata
Add docs on how to set credentials
Build and publish html to Azure artifacts storage

Bug Fixing and testing:

docs: set master doc to index
Remove missing and unused print_basic_info method
Fix destroy action because delete host now needs only host.id
Require specific versions for mrack
Fix regression in up action with OpenStack provider
Remove unused values in aws and beaker tranformation

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`145b50a`](https://github.com/neoave/mrack/commit/145b50a1a67b92cfff910ea633cd7b3f8ea4ad37))

* Remove unused values in aws and beaker tranformation

These values are loaded from metadata when generating
inventory so they do not need to be passed to provider.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`6b379e1`](https://github.com/neoave/mrack/commit/6b379e1e83512b42ffaebd979d52238bd766ca90))

* Fix regression in up action with OpenStack provider

Provisioning failed because requirements contained unexpected information.

I.e., the provider should receive only the information it expects or
are valid for OpenStack provisioning.

Removing the culprit lines: meta_image and restraint_id params.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`4cdedd1`](https://github.com/neoave/mrack/commit/4cdedd1d49850eee4229a84c36e1fdf45684be29))

* Require specific versions for mrack

It is always better to require specific versions
of dependencies because pip always installs
the latest and they may break funcionality
or create conflicts when mrack is a dependency.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`2c20866`](https://github.com/neoave/mrack/commit/2c2086664418120a521b03c9a6237bb09fe01d0d))

* Build and publish html to Azure artifacts storage

Signed-off-by: Armando Neto <abiagionredhat.com> ([`305ebc2`](https://github.com/neoave/mrack/commit/305ebc2a55f2a708879859518a2ad410169bbf2b))

* Add docs on how to set credentials

Quick guide on how set credentials for current supported providers.

Signed-off-by: Armando Neto <abiagionredhat.com> ([`ef46be9`](https://github.com/neoave/mrack/commit/ef46be9b8411312a9b333abe380411ed21b216fa))

* Fix destroy action because delete host now needs only host.id

Because of delete_host method now needs only host.id,
the Destroy action was broken and it needed to use
the host.id variable not whole object as well.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`abbb80c`](https://github.com/neoave/mrack/commit/abbb80c930c2acb519d583bb82efda8abee55f89))

* Support restraint_id record in metadata

Support restraint_id defined in metadata and later
defined in inventory for the restraint jobs.
For this we pass requirements all the way
for later inventory generation.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`59aa87f`](https://github.com/neoave/mrack/commit/59aa87f97e83c2784f0fe46da1fd22dc61f4f917))

* Remove missing and unused print_basic_info method

Add loger info message to error parsing method.
Move the parse_errors to provider.py file.
Add property error to Host object.
Delete host now needs only host_id.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`c6f8394`](https://github.com/neoave/mrack/commit/c6f8394bdfe421f9275dfb4bd2b802e9edfc9b23))

* Add basic image validation to AWS and Beaker

Added basic image validation to AWS and Beaker provider
When os was not known in provisioning config, null/None
was taken and set as required image even for Openstack.

Value of &39;os&39; is passed to req when image is not in place.
Then the &39;os&39; value is seen in ValidationError messages
even instead of None/null in Openstack, AWS and Beaker.

Support image/distro definition from metadata.
And flag it with meta_distro/meta_image when used.

For AWS check image availability with boto.
When image is not present raise ValidationError

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`1e3b298`](https://github.com/neoave/mrack/commit/1e3b298b26a7e6f494a7c9c9adfcd6a17ff1abd3))

* Create CODE_OF_CONDUCT.md

https://github.com/neoave/mrack/issues/39 ([`38a7a74`](https://github.com/neoave/mrack/commit/38a7a746c7e7be8cda93faeab1aebac02aa320be))

Bug fixing and testing:

Refactor providers to share same code
Force black version to get rid of test errors
Remove false warnings produced by isort
Add missing beaker job status
ansible-inventory: rework generation of groups

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`e5bc921`](https://github.com/neoave/mrack/commit/e5bc9211bcbfc8a8fe1709186e21c337e20fd55e))

* Force black version to get rid of test errors

When black devels change their opinion too much
we got format errors. Let us try to use versioning here.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`38b3f07`](https://github.com/neoave/mrack/commit/38b3f07292624efb55d3ac55caeb1dca0b4c2496))

* Refactor providers to share same code

Methods provision_hosts, delete_hosts and to_host
were moved to provider.py as they can be easily
shared among the providers.

Added missing methods to provider.py to share
same structure. Not implemented methods will throw
a NotImplementedError() and they are ment to be
implmented per provider.

Removed set poll sleeps based on host count.

For all providers moved STATUS_MAP to class
so from now on it is a class attribute.

Openstack&39;s wait_till_provisioned now uses
instance and not only id to match inherited method.

Added optional username parameter to to_host method in provider.py

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`b0254b2`](https://github.com/neoave/mrack/commit/b0254b2056fd05b742ba544f167f01cd1b464c89))

* ansible-inventory: rework generation of groups

The Ansible inventory output was not correctly adding hosts into groups. E.g.
group was not added when it was not defined in layout. Nested group was not
correctly found and host added.

This part is completely reworked and changes the behavior to:
- add only a host name reference (no vars) into custom groups
- add missing groups as children of &39;all&39; group
- works with both &34;groups&34; and &34;group&34; defined in metadata
- add all hosts to &39;all&39; with also variables. This ensures that the full host
object is defined only once.

Doc: https://docs.ansible.com/ansible/latest/user_guide/intro_inventory.html

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`23cdb21`](https://github.com/neoave/mrack/commit/23cdb21996310b35ea200cba36cec21d41839526))

* Add missing beaker job status

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`f476a12`](https://github.com/neoave/mrack/commit/f476a1277fe9290b380e7acecf63e01d3526b772))

* Remove false warnings produced by isort in make format

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`10bd910`](https://github.com/neoave/mrack/commit/10bd910bdac47f08af4b45ab613ec52f300028ab))

Bug fixing and testing:

Fixed username for beaker machines to be root.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`364ab4c`](https://github.com/neoave/mrack/commit/364ab4cb571eb97c609bdaccadc634f3415f02b2))

* Add username=&39;root&39; to fix ansible user

Added username=&39;root&39; to beaker host object
initialization so inventory is created
using ansible_user: root

Fix initialization of provider in a way
that we do not pass provisioning config
but only needed values.

Add status Queued as provisioning.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`b25a173`](https://github.com/neoave/mrack/commit/b25a173a02474be644b51df513640d64536f425c))

New features:

Beaker provider support

Bug fixing and testing:

Use public AWS addresses
Remove asserts and replace them with ProvisioningErrors

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`02a9fb6`](https://github.com/neoave/mrack/commit/02a9fb62accea530ac658ec6a23b88f7d126e6f2))

* Use public AWS addresses instead of private ones

Using private addresses will result into unreachable host
without vpn tunnel or mechanism to access AWS network.

Add security group, tags, keypair to init of AWS provider.
They have to be defined in provisioning config.

Remove asserts and replace them with ProvisioningErrors

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`79aa885`](https://github.com/neoave/mrack/commit/79aa8857995fa51599e9adf61c047efc286685a1))

* Add beaker provider

Beaker provider generates jobxml and then schedules
this job to beaker hub. Provider waits until job
is in Reserved state which is success.

Beaker provider requires kerberos credentials.

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`40dcb7f`](https://github.com/neoave/mrack/commit/40dcb7ff972408da74821d63fec92846227d65a2))

New features:

mrack now generates output with modules for:
- ansible-inventory
- pytest-multihost
added a static provider to create resources from static VMs
added list action to print resources from DB
added ssh action to connect quickly to VMs in DB

Bug fixing and testing:

added tests for static provider
added various minor fixes

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`43d7c6c`](https://github.com/neoave/mrack/commit/43d7c6c139366349e9ebb804f9808300c54ebcec))

* Fix style after black update

Latest version of black was complaing about these changes.

Previous version: black-19.10b0
Latest version: black-20.8b1

Signed-off-by: Armando Neto <abiagionredhat.com> ([`b850639`](https://github.com/neoave/mrack/commit/b8506391e12f3be1c7027109d9b27c17888a504e))

* Set defaults for pytest and remove xunit1 format warning message

So that we can more easily inspect in azure if new tests were run
properly and also be able to see the results.

Mainly it removes warning message about deprecating xunit1 format.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`fc28e66`](https://github.com/neoave/mrack/commit/fc28e664a9d94a568df70312ed693877e56d8aa9))

* Add test scenario for actions with static provider

Testing up, output, list and destroy actions using the Static Provider.

Signed-off-by: Armando Neto <abiagionredhat.com> ([`50dcc77`](https://github.com/neoave/mrack/commit/50dcc779c26e0e14bfc6069420b9f6bed36ccfb0))

* Handle output action error

Running `mrack output` with an empty database breaks
`python-pytest-multihost` config file. (E.g: Not running `mrack
up` before trying that.)

Signed-off-by: Armando Neto <abiagionredhat.com> ([`3b71d86`](https://github.com/neoave/mrack/commit/3b71d86c70b339eac4246c7c8b0a452109c5fd2f))

* Print message only

Signed-off-by: Armando Neto <abiagionredhat.com> ([`089c80c`](https://github.com/neoave/mrack/commit/089c80c1841191a9a0bed63c545c671006963e5e))

* Docs: do not use source/_static directory

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`be8d5fa`](https://github.com/neoave/mrack/commit/be8d5fadf03df53d61f55321314dab45219b867b))

* Load the requirements.txt in setup.py

Load the content of requirements.txt file
instead of having static list in setup.py

Update the test-requirements.txt to contain
all necessary dependencies to test.

Add requirements.txt to tox.ini

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`a20e288`](https://github.com/neoave/mrack/commit/a20e288c819318a884888d9b5a780ce5c34cafc1))

* Normalize all imports

Signed-off-by: Armando Neto <abiagionredhat.com> ([`e00a77a`](https://github.com/neoave/mrack/commit/e00a77acb25cc3254129141a66df23b006e638b5))

* Enable isort linting

Helper tool to sort the imports for us.

Signed-off-by: Armando Neto <abiagionredhat.com> ([`e56d267`](https://github.com/neoave/mrack/commit/e56d2678c6e3eafa34d93427f5b42efe81d86059))

* Rename aiohabit project to mrack

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`4b4233f`](https://github.com/neoave/mrack/commit/4b4233f9a6b0e141e744b0ac2ec39d3f557b021d))

* Replace print statements with logging

Adding logging calls to replace print statements.
Rename exception objects to three letters to not mess with pdb.

Signed-off-by: Armando Neto <abiagionredhat.com> ([`8ec7bf9`](https://github.com/neoave/mrack/commit/8ec7bf98391adb4bc02de381268577f857bbdd0a))

* Add basic logging mechanism

Configure a logger to be used in the whole application.

If user pass `--debug` to aiohabit log level is changed to DEBUG.

Signed-off-by: Armando Neto <abiagionredhat.com> ([`c41f93b`](https://github.com/neoave/mrack/commit/c41f93b2e3dc736563dce2bce59c1bcb60a9c58a))

* AWS host: Return the right status

Signed-off-by: Armando Neto <abiagionredhat.com> ([`6c02c34`](https://github.com/neoave/mrack/commit/6c02c347074ff9461a5e332da6d27bb81ca7a605))

* ansible-inventory: fix bug when python interpreter not defined for os

E.g. so that the default python interpreter will be used.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`dfddfaf`](https://github.com/neoave/mrack/commit/dfddfafa714e04d21d1134d16a3a51d5d43a4be5))

* Static provider

Static provider serves for mixing already provisioned hosts (pets)
with dynamically provisioned hosts. Alternatively all hosts can
be static. This can be useful for generating the outputs and using
other features.

Almost all operations are fake given that the hosts exist and cannot
be deleted by static provider. The most important parts is to provide
a name and ip.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`f3bc80b`](https://github.com/neoave/mrack/commit/f3bc80b009be50108109d4f126013aaa40463814))

* Add SSH action

To make it very easy to SSH into a host based on value in various
configuration objects.

It is usually very time-consuming to &34;cat&34; e.g. inventory, copy the
real hostname/IP, write all the SSH options including determining
if it should use SSH key and what is its location.

The interactive mode even saves time with writing the fake hostname.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`044de05`](https://github.com/neoave/mrack/commit/044de0569a19138c178c93d747530f50d2e735d2))

* Host: add first IP getter

To avoid copy&paste in SSH action

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`749d666`](https://github.com/neoave/mrack/commit/749d666e0c18c1eacc2ee4a18c576fc9421191a4))

* Common methods to figure out username, password, ssh key for a host

To avoid copy&paste in ssh action.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`22c163f`](https://github.com/neoave/mrack/commit/22c163fd1120b6b0c42091551f79713be49bf7de))

* Add list action

To quickly show content of DB in human readable form

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`a7a6114`](https://github.com/neoave/mrack/commit/a7a611471404e5b2a268056f54c2b0cdda43e623))

* Host: include status in print

So that it is known which hosts are still active.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`b993302`](https://github.com/neoave/mrack/commit/b9933021956e9436ddfd68343d201745929d528d))

* Add Ansible Inventory and pytest-multihost output modules

And enhance &34;up&34; action to use them. Add also &34;output&34; action which
calls them separately. It can be used for recreation of deleted ones
or testing.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`97f482e`](https://github.com/neoave/mrack/commit/97f482e2e9338c618fdec42bb2f4970057725976))

* hosts: adding missing properties

So that they can be work with in output modules.

Signed-off-by: Petr Vobornik <pvoborniredhat.com> ([`ceb5e93`](https://github.com/neoave/mrack/commit/ceb5e9389981b776cdfd9e28f558ee70415da211))

Unknown

* Add AWS provider

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`173b259`](https://github.com/neoave/mrack/commit/173b259b39a6975f57d9d82b3b78565bf82e4b48))

* Do not use relative imports

Signed-off-by: Tibor Dudlák <tdudlakredhat.com> ([`5f69bdc`](https://github.com/neoave/mrack/commit/5f69bdc53fd54539a3f65a2f1c547707e194539e))