Aac-metrics

Latest version: v0.5.4

Safety actively analyzes 690691 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 3

0.5.4

Fixed
- Backward compatibility of `BERTScoreMrefs` with torchmetrics prior to 1.0.0.

Deleted
- `Version` class to use `packaging.version.Version` instead.

0.5.3

Fixed
- Fix `BERTScoreMrefs` computation when all multiple references sizes are equal.
- Check for empty timeout list in `SPICE` metric.

0.5.2

Changed
- `aac-metrics` is now compatible with `transformers>=4.31`.
- Rename default device value `"auto"` to `"cuda_if_available"`.

0.5.1

Added
- Check sentences inputs for all metrics.

Fixed
- Fix `BERTScoreMRefs` metric with 1 candidate and 1 reference.

0.5.0

Added
- New `Vocab` metric to compute vocabulary size and vocabulary ratio.
- New `BERTScoreMRefs` metric wrapper to compute BERTScore with multiple references.

Changed
- Rename metric `FluErr` to `FER`.

Fixed
- `METEOR` localization issue. ([9](https://github.com/Labbeti/aac-metrics/issues/9))
- `SPIDErMax` output when `return_all_scores=False`.

0.4.6

Added
- Argument `clean_archives` for `SPICE` download.

Changed
- Check if newline character is in the sentences before ptb tokenization. ([6](https://github.com/Labbeti/aac-metrics/issues/6))
- `SPICE` no longer requires bash script files for installation.

Fixed
- Maximal version of `transformers` dependancy set to 4.31.0 to avoid error with `FENSE` and `FluErr` metrics.
- `SPICE` crash message and error output files.
- Default value for `Evaluate` `metrics` argument.

Deleted
- Remove now useless `use_shell` option for download.

Page 1 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.