- Add missing await (55, thanks amirhmk!) - Add traceback for failing to load preprocess class (57) - Fix Triton `config.pbtxt` is not checked for missing values or colliding specifications (62) - Add safer code for pulling from Kafka - Add `str` type to Triton type conversion - Fix ignore auto detected `platform` when passing `config.pbtxt` with `platform` entry - Fix Triton engine model with multiple versions was not properly supported - Fix serving session keep alive is also sent on idle - Fix examples readme files - Log preprocess exceptions with full stack trace to serving session console output
1.3.0
Not secure
Stable Release
* Features * 20% Overall performance increase :rocket: thank you python 3.11 :fire: * gRPC channel configuration 49 amirhmk * Huggingface Transformer example
Bug Fixes - Fix `PYTHONPATH` is overwritten when executing a task (append to it instead) - Fix pytorch package is reinstalled when the same version is already installed - Fix copying configuration sets an empty worker name - Protect dynamic GPUs from failing to parse worker GPU index
1.2.2
Bug Fixes
- Fix `CLEARML_AGENT_SKIP_PIP_VENV_INSTALL` fails to find python executable - Fix `apt-get update` failure causes `apt-get install` not to be executed
1.2.1
Not secure
Bug Fixes
- Fix HTTP download fails constructing URL (593)
1.2.0
Not secure
Stable Release
* Features * GPU Performance improvements, 50%-300% improvement over vanilla Triton * Performance improvements on CPU, optimize uvloop + multi-processing * Huggingface Transformer example * Binary input support, 37 , thanks Aleksandar1932
* Bug fixes * stdout/stderr in inference service was not logged to dedicated Task