Clearml

Bug Fixes

- Fix pipeline breaks when `continue_on_abort` is set to true
- Fix Pycharm Plugin Windows/Linux interoperability

New Features

- Add additional warning instructing on how to install in case we failed detecting a Jupyter notebook with an import error
- Add `Task.get_executed_queue()` to get the name/ID of the queue a task was executed in
- Move `Task.set_resource_monitor_iteration_timeout()` to a class method, add `wait_for_first_iteration_to_start_sec` and `max_wait_for_first_iteration_to_start_sec` arguments (also add `sdk.development.worker.wait_for_first_iteration_to_start_sec` and `sdk.development.worker.max_wait_for_first_iteration_to_start_sec` configuration options)
- Add support for better pipeline continue behavior including control of children using the `continue_behaviour` argument
- Add Python 3.12 support

Bug Fixes

- Fix issue 1249 pytorch-lightning patches (1254, thanks a-gardner1!)
- Fix parameter overrides are converted to string when using HPO (975)
- Fix FastAI performance (1234)
- Fix MIG GPU support
- Fix AMD GPU metrics collection
- Fix Jupyter password might not be used in some protected Jupyterlab instances
- Fix URL substitution was not applied to registered uploaded files when reporting an event

Bug Fixes

- Fix auto-scaler should recheck that the worker is still IDLE before shutting it down (1240, thanks cthorey!)
- Fix resource monitor fails to get GPU stats in some edge cases

New features and Bug Fixes

- Add more verbose error on `--verbose`
- Delete old sessions only after a successful session was created (this ensures we do not delete workspaces unless we have a new successful session)
- Delete old sessions after SSH connection is established only if restoring a workspace, otherwise delete at setup time
- Add python 3.12 support
- Add missing `psutil` package

Bug Fixes

- Fix AWS S3 configuration `secure` property not forwarded in `StorageHelper` (1205, thanks odulcy-mindee!)
- Fix `NVIDIA_VISIBLE_DEVICES=all` env var value will result in no GPU metrics being reported
- Fix setting `output_uri` when an AWS S3 config section with `secure=false` exists raises an error
- Fix `CacheManager` attempts to clear cache when file limit has not been reached resulting in slow unnecessary checks

New Features and Bug Fixes

- Add hash check for pickle files (resolves CVE-2024-24590)
- Fix `clearml-task` relative paths calculation when `--cwd`, `--folder` and `--script` are provided (1161, thanks dimidagd!)
- Fix regression causing an error when `secure` is provided in AWS S3 bucket settings