Transformers-openai-api

Latest version: v1.1.0

Safety actively analyzes 625566 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

1.1.0

- Add support for [accelerate](https://github.com/huggingface/accelerate).

This release is a breaking configuration change as models will no longer switch to CPU inference mode in the absence of a CUDA device -- rather, new configuration parameters `MODEL_DEVICE` and `TOKENIZER_DEVICE` must be set explicitly on each model. For more details see the "Models" section of the README.

1.0.3

- Remove `logit_bias` from `generate` arguments

1.0.2

- Fallback to CPU inference when CUDA not available (thanks Yongtae723)
- Add `/metrics` endpoint

1.0.0

Initial release

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.