Clearml-agent

New Features and Improvements
- Upgrade requirements for `attrs`, `jsonschema`, `pyparsing`, `six` and `pyjwt` (129)
- Add default output URI selection to `clearml-agent init`
- Add `agent.disable_task_docker_override` configuration option to disable docker override specified in executing tasks
- Add `CLEARML_AGENT_FORCE_SYSTEM_SITE_PACKAGES` env var (default `true`) to allow overriding default `system_site_packages: true` behavior when running tasks in containers (docker mode and k8s-glue)

Bug Fixes
- Fix using deprecated types validator argument raises an error (deprecated even before `jsonschema` 3.0.0 and unsupported since 4.0.0)
- Fix pip support allowing multiple pip version constraints (by default, one for < Python 3.10 and one for >= Python 3.10)

New Features and Improvements
- Add option to crash agent on exception using `agent.crash_on_exception` configuration setting (123, thanks nielstenboom!)
- Improve venv cache disabled message
- Upgrade packages for better Python 3.10 support
- Remove future package dependency (Python 2 is not supported for `clearml-agent`)
- Change default pip version used to `pip<21` for better Python 3.10 support
- Add support for operator `!=` in package version (mostly for better pytorch resolving)
- Add support for PyTorch new `extra_index_url repo` (find the correct index url based on the cuda version, and let pip do the rest)
- Make venv caching the default behavior
- Add support for `CLEARML_AGENT_DOCKER_ARGS_HIDE_ENV` environment variable (see `agent.hide_docker_command_env_vars` config option)
- Ping executing tasks to make sure the server does not consider them stale (set using the `agent.task_ping_interval_sec` configuration option, defaults to every 120 seconds)

Bug Fixes
- Fix docker extra arguments showing up in configuration printout
- Fix an issue with running on Python 3.10 / 3.11
- Fix cached git token prevents cloning repository (using `agent.enable_git_ask_pass` forcing the agent to use `GIT_ASKPASS` for user/password when cloning/fetching repositories)
- Fix setting `CLEARML_API_DEFAULT_REQ_METHOD` raises an error
- Fix `get_task_session()` may cause an old copy of the `APIClient` to be used containing a reference to the previous session
- K8s Glue
- Fix `agent.system_site_packages` is not turned on by default in k8s glue
- Make sure we git_user/pass is passed to the task pod
- Remove support for `kubectl run`

Improvements
- Add warning if venv cache is disabled
- Add `agent.disable_ssh_mount` configuration option (same as the `CLEARML_AGENT_DISABLE_SSH_MOUNT` environment variable)

Bug Fixes
- Fix docker command for monitoring child agents
- Fix `--gpus all` not reporting GPU stats on worker machine

New Features and Improvements
- Add support for MIG devices (use `0:1` for GPU 0 slice 1, or use `0.1`)
- Add `agent.enable_git_ask_pass` to improve passing user/pass to git commands
- Add docker `ssh_ro_folder` (default `/.ssh`) and changed docker `ssh_folder` (default: `~/.ssh`)
- Allow overriding pytorch lookup page (See `torch_page`, `torch_nightly_page` and `torch_url_template_prefix` under the `agent.package_manager` configuration settings)
- Add support for abort callback registration
- K8s glue
- Add `CLEARML_K8S_GLUE_START_AGENT_SCRIPT_PATH` environment variable to allow customizing the agent startup script location
- Add debug environment variable `CLEARML_AGENT_DEBUG_INFO`
- Add `CLEARML_AGENT_CHILD_AGENTS_COUNT_CMD` environment variable to allow overriding child agent count command in k8s
- Refactor template handling

Bug Fixes
- Fix Python 3.10+ support
- Fix `use_credentials_chain` is missing in config file example
- Fix Git PAT messages
- Fix home folder in `clearml.conf` to `~` (instead of `/root`)
- Fix docker mode uses `~/.clearml/venvs-builds` as default for easier user-mode containers
- Fix package ` file://` with quoted (URL style) links should not be ignored
- Fix name not escaped as regex (all services "get_all" use regex for name)
- Fix second `.ssh` temp mount fails if container changes the files inside
- Fix GCP load balancer does not forward GET request body (allow changing default request action to `PUT/POST/GET`. See `api.http.default_method` or `CLEARML_API_DEFAULT_REQ_METHOD`)
- K8s glue
- Fix resolving k8s pending queue may cause a queue with a UUID name to be created
- Fix template namespace should override default namespace
- Fix `extra_bash_init_cmd` location in initial bash script
- Fix debug mode
- Fixed documentation (117)

New Features and Improvements

- Support private repos from `requirements.txt` file (107, thanks nielstenboom!)
- Bump PyJWT version due to "Key confusion through non-blocklisted public key formats" vulnerability
- Add support for additional command line arguments in k8s glue example
- Add Python 3.10 support

Bug Fixes

- Fix git unsafe directory issue (disable check on cached vcs folder)
- Fix dynamic GPUs with "all" GPUs on the same worker
- Fix broken pytorch setuptools incompatibility (force setuptools < 59 if torch is below 1.11)
- Fix setuptools requirement issue by making sure that if we have "setuptools" in the original required packages, we preserve the line in the pip freeze list
- Fix optional priority packaged always compare lower case package name
- Fix potential requirements installation failure by making `pygobject` an optional package (i.e. if installation fails continue the Task package environment setup)
- Fix repository URL contains credentials even when `agent.force_git_ssh_protocol: true`

Bug Fixes
- Fix `PYTHONPATH` is overwritten when executing a task (append to it instead)
- Fix pytorch package is reinstalled when the same version is already installed
- Fix copying configuration sets an empty worker name
- Protect dynamic GPUs from failing to parse worker GPU index