Scandeval

Latest version: v12.10.8

Safety actively analyzes 642295 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 14 of 21

1.3.7

Not secure
Fixed
- Removed `transformers` logging during evaluation as well.

1.3.6

Not secure
Changed
- Now only updating the list of benchmarks in the `Benchmark` during
initialisation, and also logs it. This should make subsequent calls to the
`benchmark` method faster.

Fixed
- Removed `transformers` logging properly.

1.3.5

Not secure
Fixed
- Set the number of warmup steps to be the intended one training set pass,
where previously it was effectively 8x that amount, due to gradient
accumulation.
- Added the NER label synonyms `OBJORG=ORG`, `LOCPRS=LOC`, `LOCORG=LOC` and
`ORGPRS=ORG`.
- Explicitly added `numpy` to the `install_requires` list. This is normally not
a problem, as it's a requirement for other required packages, but this
depends on the order in which the requirements are installed. This avoids
such errors caused by misordering the requirements.

1.3.4

Not secure
Fixed
- Indexing error during synonym setup of finetuned models.

1.3.3

Not secure
Fixed
- When a finetuned model has labels which are synonyms of each other, they are
now properly treated as synonyms, where previously this caused the model to
have misaligned `id2label` and `label2id` conversion dictionaries.

1.3.2

Not secure
Fixed
- Added the NER label synonyms `GPE_LOC=LOC`, `GPE_ORG=ORG`, `LOC/ORG=LOC`,
`ORG/PRS=ORG`, `OBJ/ORG=ORG`, as Norwegian and Swedish models tend to use
these.

Page 14 of 21

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.