Clearml

Features and Bug Fixes

- Add Logger histogram mode (stack/group/relative)
- Add PEP610 support for new pip>=20.1 git reference feature (see https://github.com/pypa/pip/issues/609) #62
- Better support for PyTorch Ignite integration
- Support `` and `?` in uploaded image file names
- Support `ArgumentParser.parse_arg()` used before initializing task when `auto_connect_arg_parser=False`
- Fix upload_object_via_stream() in Azure storage driver
- Fix `Task.get_tasks()` return type

Features

- Add media (audio) support for both Logger and Tensorboard binding using `Logger.report_media()` 120
- Add autokeras example (see [here](https://github.com/allegroai/trains/tree/master/examples/autokeras)) #125
- Add caching of extracted zip artifacts
- Add `Task.get_tasks()` filtering support
- Add `trains.storage.StorageManager`
- Add nicer stdout log flush
- Add text logging to TF V1 example
- Improve SSL retries and error handling
- Improve shutdown behavior in case of a user abort (Ctrl-C)
- Improve repository and module detection
- Improve resource monitor
* Report memory usage for process (and sub-processes)
* Report GPU memory usage for process (and sub-processes)
* Stability
- Improve Jupyter support
* Make sure `trains` is included in Jupyter requirements
* Ignore IPython directives in converted Python script (like `%` and `!` lines)
- Update Pytorch/TensorboardX examples

Bug Fixes

- Fix renaming/deleting model file right after saving will break asynchronous upload 123
- Fix shutdown behavior:
* Logger flush delay and termination
* Repository/package detection termination
* Threads termination
- Fix text encoding `utf-8` and `pr_curve` broken in Tensorboard support
- Fix single log request exceeds max packet size
- Fix upload debug assets with series / title including `,` or `/` did not add iteration index to the filename
- Fix `scikit-learn` module detection
- Use UID in message if user name cannot be retrieved (from the [Trains Slack channel](https://github.com/allegroai/trains#documentation-community--support))
- Fix cast in Tensorflow v2 example

Features and Bug Fixes

- Add daemon detached mode (`--detached`, `-d`) that runs the agent as daemon in the background and returns immediately
- Auto mount `~/.git-credentials` into docker container (if file exists)
- Add `TRAINS_AGENT_EXTRA_PYTHON_PATH` environment variable to allow adding additional python path during experiment execution (helpful when using extra un-tracked modules)
- Fix "run as user" feature (using `TRAINS_AGENT_EXEC_USER` environment variable)
- Fix PyTorch support to ignore minor versions when looking for package to install/download
- Fix experiment execution output handling

Features and Bug Fixes

- Add support for `trains-agent execute --id <experiment-id> --docker` that allows executing a specific experiment inside a docker container
- Add support for `trains-agent execute --id <template-experiment-id> --clone` that clones the provided experiment and executes the cloned experiment
- Add support for `APIClient.models.delete()` to allow programmatically deleting a model https://github.com/allegroai/trains-server/issues/32
- Add daemon support for passing storage-related OS environment variables to experiments executed inside a docker container (supported by `trains>=0.13.3`):
* AWS: `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY` and `AWS_DEFAULT_REGION`
* Azure: `AZURE_STORAGE_ACCOUNT` and `AZURE_STORAGE_KEY`
* Google: `GOOGLE_APPLICATION_CREDENTIALS`
- Fix git checkout with submodules https://github.com/allegroai/trains/issues/112
- Prefer docker image from command line over the one specified in experiment

Features and Bug Fixes

- Allow providing queue names instead of queue IDs in daemon mode
- Docker mode improvements
* Support running as a specific user inside a docker using the `TRAINS_AGENT_EXEC_USER` environment flag
* Pass correct GPU limit when skipping gpus flag
* Add `--force-current-version` daemon command-line flag
- Add K8s/trains glue service example
- Added K8s support in daemon mode
* Running inside a K8s pod
* Mounting dockerized experiment folders to host
* Allow a specific network for the docker
- Add default storage environment vars (for AWS, GS and Azure) to generated agent configuration
- Improve Unicode/UTF stdout handling

Features and Bug Fixes

* Pre-install `numpy` if it exists in the requirements
* Add experiment archiving example
* Add `.bashrc` reloading before running trains-agent in the AWS dynamic cluster management service
* Add support for pulling recursive git modules as as well as main project
* Limit `virtualenv` version to `<20` due to an import issue in v20.0.0
* Fix `pip` install/upgrade with limit in `conda`
* Fix daemon monitor to not stop experiments if network is down