Scandeval

Latest version: v12.10.8

Safety actively analyzes 641872 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 21

12.10.8

Fixed
- An import error caused `openai` to be installed for any evaluations to be done, which
has now been fixed.

12.10.7

Fixed
- Require `numpy` to be of version `1.x.x`, as the new `2.0.0` clashes with `outlines`.

12.10.6

Fixed
- Updated `optimum` to `>=1.20.0` as `1.19.x` is incompatible with newer `transformers`
versions.
- Updated `outlines` to `>=0.44.0` as this fixes an error in evaluating NorwAI models.

12.10.5

Changed
- Remove almost all upper version bounds on dependencies. This makes it easier to be
compatible with the `scandeval` package, with the risk of potentially introducing
bugs when new dependency versions appear. We will monitor this risk and see if this
is the way to go.

Fixed
- Update `vllm` to `>=0.5.0`, `outlines` to `>=0.0.37` and `tiktoken` to `>=0.7.0`,
which now resolves the dependency clash between the three of them.
- When detecting the `outlines` version we expected it to consist of integers, but we
now accept strings as well (for development versions, say).

12.10.4

Fixed
- Access to the evaluation datasets were shut down by Hugging Face again. It has now
been restored.

12.10.3

Fixed
- Access to the evaluation datasets were shut down by Hugging Face. It has now been
restored.

Page 1 of 21

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.