Scandeval

Latest version: v12.10.8

Safety actively analyzes 642295 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 11 of 21

2.3.2

Not secure
Fixed
- Fixed a bug where a model's framework and pipeline tag were
indistinguishable, as they are both using the same `tag-white` tag now.

2.3.1

Not secure
Fixed
- Changed the `tag-red`, which referred to the HTML class containing the model
framework, to `tag-white`. This caused models to not be benchmarkable, as
their framework could not be determined.

2.3.0

Not secure
Added
- Specific branches/commits/tags can now be benchmarked, using the ``
delimiter. For instance, `scandeval -m model_idcommit_hash` will benchmark
the model with model ID `model_id`, stored at commit with hash `commit_hash`.
Thanks to [versae](https://github.com/versae) for contributing! :tada:

2.2.0

Not secure
Added
- Added more label synonyms for the DKHate dataset.

2.1.0

Not secure
Added
- Added support for `flax` models. Thanks to
[versae](https://github.com/versae) for contributing! :tada:

2.0.0

Not secure
Fixed
- Changed the anonymisation procedure for the tweet datasets `angry-tweets` and
`twitter-sent`, now replacing user names by USER and links by [LINK].

Page 11 of 21

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.