Clearml

Improvements
- Add warning if venv cache is disabled
- Add `agent.disable_ssh_mount` configuration option (same as the `CLEARML_AGENT_DISABLE_SSH_MOUNT` environment variable)

Bug Fixes
- Fix docker command for monitoring child agents
- Fix `--gpus all` not reporting GPU stats on worker machine

New Features and Improvements
- Add support for MIG devices (use `0:1` for GPU 0 slice 1, or use `0.1`)
- Add `agent.enable_git_ask_pass` to improve passing user/pass to git commands
- Add docker `ssh_ro_folder` (default `/.ssh`) and changed docker `ssh_folder` (default: `~/.ssh`)
- Allow overriding pytorch lookup page (See `torch_page`, `torch_nightly_page` and `torch_url_template_prefix` under the `agent.package_manager` configuration settings)
- Add support for abort callback registration
- K8s glue
- Add `CLEARML_K8S_GLUE_START_AGENT_SCRIPT_PATH` environment variable to allow customizing the agent startup script location
- Add debug environment variable `CLEARML_AGENT_DEBUG_INFO`
- Add `CLEARML_AGENT_CHILD_AGENTS_COUNT_CMD` environment variable to allow overriding child agent count command in k8s
- Refactor template handling

Bug Fixes
- Fix Python 3.10+ support
- Fix `use_credentials_chain` is missing in config file example
- Fix Git PAT messages
- Fix home folder in `clearml.conf` to `~` (instead of `/root`)
- Fix docker mode uses `~/.clearml/venvs-builds` as default for easier user-mode containers
- Fix package ` file://` with quoted (URL style) links should not be ignored
- Fix name not escaped as regex (all services "get_all" use regex for name)
- Fix second `.ssh` temp mount fails if container changes the files inside
- Fix GCP load balancer does not forward GET request body (allow changing default request action to `PUT/POST/GET`. See `api.http.default_method` or `CLEARML_API_DEFAULT_REQ_METHOD`)
- K8s glue
- Fix resolving k8s pending queue may cause a queue with a UUID name to be created
- Fix template namespace should override default namespace
- Fix `extra_bash_init_cmd` location in initial bash script
- Fix debug mode
- Fixed documentation (117)

New Features and Improvements
- Add support for setting reported values for `NaN` and `Inf` 604
- Add reserved OS environments warning
- Add git credentials to colab example 621 (thanks thepycoder!)
- Add jsonargparse support 403 (thanks ajecc and mauvilsa!)
- Update autokeras example

Bug Fixes
- Fix sub-project separators are incorrectly quoted in generated URLs 584
- Revert Optuna deprecation fix 613
- Fix HPO randomly aborts running tasks before the time limit
- Fix cloud driver overwrites `agent.extra_docker_arguments`
- Fix Pipeline Controller auto-magic framework connect
- Fix unused scroll is not cleared in `Task.get_reported_plots()`

New Features and Bug Fixes

- Add missing await (55, thanks amirhmk!)
- Add traceback for failing to load preprocess class (57)
- Fix Triton `config.pbtxt` is not checked for missing values or colliding specifications (62)
- Add safer code for pulling from Kafka
- Add `str` type to Triton type conversion
- Fix ignore auto detected `platform` when passing `config.pbtxt` with `platform` entry
- Fix Triton engine model with multiple versions was not properly supported
- Fix serving session keep alive is also sent on idle
- Fix examples readme files
- Log preprocess exceptions with full stack trace to serving session console output

New Features and Improvements

- Support private repos from `requirements.txt` file (107, thanks nielstenboom!)
- Bump PyJWT version due to "Key confusion through non-blocklisted public key formats" vulnerability
- Add support for additional command line arguments in k8s glue example
- Add Python 3.10 support

Bug Fixes

- Fix git unsafe directory issue (disable check on cached vcs folder)
- Fix dynamic GPUs with "all" GPUs on the same worker
- Fix broken pytorch setuptools incompatibility (force setuptools < 59 if torch is below 1.11)
- Fix setuptools requirement issue by making sure that if we have "setuptools" in the original required packages, we preserve the line in the pip freeze list
- Fix optional priority packaged always compare lower case package name
- Fix potential requirements installation failure by making `pygobject` an optional package (i.e. if installation fails continue the Task package environment setup)
- Fix repository URL contains credentials even when `agent.force_git_ssh_protocol: true`

Bug Fixes
- Fix `PYTHONPATH` is overwritten when executing a task (append to it instead)
- Fix pytorch package is reinstalled when the same version is already installed
- Fix copying configuration sets an empty worker name
- Protect dynamic GPUs from failing to parse worker GPU index