Clearml-agent

New Features and Improvements
- Add support for MIG devices (use `0:1` for GPU 0 slice 1, or use `0.1`)
- Add `agent.enable_git_ask_pass` to improve passing user/pass to git commands
- Add docker `ssh_ro_folder` (default `/.ssh`) and changed docker `ssh_folder` (default: `~/.ssh`)
- Allow overriding pytorch lookup page (See `torch_page`, `torch_nightly_page` and `torch_url_template_prefix` under the `agent.package_manager` configuration settings)
- Add support for abort callback registration
- K8s glue
- Add `CLEARML_K8S_GLUE_START_AGENT_SCRIPT_PATH` environment variable to allow customizing the agent startup script location
- Add debug environment variable `CLEARML_AGENT_DEBUG_INFO`
- Add `CLEARML_AGENT_CHILD_AGENTS_COUNT_CMD` environment variable to allow overriding child agent count command in k8s
- Refactor template handling

Bug Fixes
- Fix Python 3.10+ support
- Fix `use_credentials_chain` is missing in config file example
- Fix Git PAT messages
- Fix home folder in `clearml.conf` to `~` (instead of `/root`)
- Fix docker mode uses `~/.clearml/venvs-builds` as default for easier user-mode containers
- Fix package ` file://` with quoted (URL style) links should not be ignored
- Fix name not escaped as regex (all services "get_all" use regex for name)
- Fix second `.ssh` temp mount fails if container changes the files inside
- Fix GCP load balancer does not forward GET request body (allow changing default request action to `PUT/POST/GET`. See `api.http.default_method` or `CLEARML_API_DEFAULT_REQ_METHOD`)
- K8s glue
- Fix resolving k8s pending queue may cause a queue with a UUID name to be created
- Fix template namespace should override default namespace
- Fix `extra_bash_init_cmd` location in initial bash script
- Fix debug mode
- Fixed documentation (117)

New Features and Improvements

- Support private repos from `requirements.txt` file (107, thanks nielstenboom!)
- Bump PyJWT version due to "Key confusion through non-blocklisted public key formats" vulnerability
- Add support for additional command line arguments in k8s glue example
- Add Python 3.10 support

Bug Fixes

- Fix git unsafe directory issue (disable check on cached vcs folder)
- Fix dynamic GPUs with "all" GPUs on the same worker
- Fix broken pytorch setuptools incompatibility (force setuptools < 59 if torch is below 1.11)
- Fix setuptools requirement issue by making sure that if we have "setuptools" in the original required packages, we preserve the line in the pip freeze list
- Fix optional priority packaged always compare lower case package name
- Fix potential requirements installation failure by making `pygobject` an optional package (i.e. if installation fails continue the Task package environment setup)
- Fix repository URL contains credentials even when `agent.force_git_ssh_protocol: true`

Bug Fixes
- Fix `PYTHONPATH` is overwritten when executing a task (append to it instead)
- Fix pytorch package is reinstalled when the same version is already installed
- Fix copying configuration sets an empty worker name
- Protect dynamic GPUs from failing to parse worker GPU index

Bug Fixes

- Fix `CLEARML_AGENT_SKIP_PIP_VENV_INSTALL` fails to find python executable
- Fix `apt-get update` failure causes `apt-get install` not to be executed

New Features and Improvements

- Update S3 bucket verify option for minio 83 (thanks pshowbs!)
- Add environment variable for request method 91 (thanks mmiller-max!)
- Add additional k8s-glue dockerfiles 94 (thanks xadcoh!)
- Update default docker image to `nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04`
- Add support for custom docker image resolving using the `agent.default_docker.match_rules` configuration setting (see [here](https://github.com/allegroai/clearml-agent/blob/8712c5e636d9a02e939a9759348d29521a3939a9/docs/clearml.conf#L169))
- Add `agent.force_git_root_python_path` configuration setting to force adding the git repository root folder to the `PYTHONPATH` (if set working directory is not added to the `PYHTONPATH`)
- Add `build --force-docker` command line argument to the to allow ignoring task container data
- Add `agent.poetry_version` configuration setting to specify poetry version (and force installation of poetry if missing, see [here](https://github.com/allegroai/clearml-agent/blob/8712c5e636d9a02e939a9759348d29521a3939a9/docs/clearml.conf#L65))
- Add custom build script support
- Add extra configurations when starting daemon
- Add `agent.package_manager.force_original_requirements` configuration option, allowing to only use original requirements produced by local execution (note that using this configuration option prevents editing installed packages using the UI)
- Add support for the `CLEARML_AGENT_PROPAGATE_EXITCODE` environment variabe. Set this variable to `1` to allow ClearML Agent to return a nonzero exit code on failure
- Update `clearml-agent init` (use `app.clear.ml` as default server, add git token references)

Bug Fixes

- Fix virtualenv python interpreter used 98 (thanks idantene!)
- Fix typing package incorrectly required for Python>3.5 103 (thanks Honzys!)
- Fix symbolic links not copied from cached VCS into working copy (windows platform will result with default copy content instead of original symbolic link) 89
- Fix agent fails to check out code from main branch when branch/commit is not explicitly specified https://github.com/allegroai/clearml/issues/551
- Fix `git+git://` requirements
- Fix `default_python` calculation (and verbosity)
- Fix using deprecated `abc` support (Python 3.10 compatibility)
- Fix no default value for `CLEARML_API_DEFAULT_REQ_METHOD` causes `ValueError` if not specified
- Fix `agent.hide_docker_command_env_vars` mode to include URL passwords and handle environment vars containing docker commands
- Fix conda package manager listed packages with local links (` file://`) should ignore the local package if it does not exist
- Fix cuda patch version support in conda
- Fix agent attempts to check out code when in standalone mode
- Fix `FORCE_LOCAL_CLEARML_AGENT_WHEEL` environment variable handling when running from a Windows host
- Fix user-provided `"` is unnecessarily replaced to `\\"`
- Fix token is not propagated to docker in case credentials are not available
- Fix PyTorch aarch64 and windows support
- Fix VCS packages are reinstalled when the same commit version is already installed
- Fix git packages are installed even if commit is given and is preinstalled when using cached virtual environment

Bug Fixes
- This release fixes the `six` conflict with the new `pathlib2` version 2.3.7 and up.