Mteb

Latest version: v1.20.0

Safety actively analyzes 682487 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 26 of 58

1.12.12

Fix

* fix: Updated the revision of dataset (866)

* Updated the revision of dataset

* Updated the test results ([`e48eef9`](https://github.com/embeddings-benchmark/mteb/commit/e48eef9457b246adaba5e16064c425374d78dad8))

1.12.11

Documentation

* docs: removed spacing is github user name ([`facdb76`](https://github.com/embeddings-benchmark/mteb/commit/facdb7653cd14e92dfe853da6054e8fa0f7247bb))

Fix

* fix: Convert MLSUM to fast (865)

* add MLSUMClusteringS2S.v2

* add e5 results

* add MLSUMClusteringS2SFast

* points

* make lint

* review ([`b70bb5a`](https://github.com/embeddings-benchmark/mteb/commit/b70bb5afd808b7a46094029ab07604a08fbd7356))

Unknown

* Update tasks table ([`d3413b9`](https://github.com/embeddings-benchmark/mteb/commit/d3413b9d48f088132aa36d90dcb892d9db160aa0))

* Update points table ([`4ebc68a`](https://github.com/embeddings-benchmark/mteb/commit/4ebc68af640ea54ebcf55430596bbd6c4faa9582))

* Update points table ([`bad247a`](https://github.com/embeddings-benchmark/mteb/commit/bad247afaefc3ba8a6b8ab36376a24cdd36504cc))

1.12.10

Fix

* fix: add check_label_distribution for ClusteringFast (862)

* check_label_distribution and results

* make lint

* points

* correct validation ([`6afb8a9`](https://github.com/embeddings-benchmark/mteb/commit/6afb8a9b923e59a32affd6ca3671d257387ce086))

Unknown

* Update tasks table ([`a2ad6ef`](https://github.com/embeddings-benchmark/mteb/commit/a2ad6efb903e1611c18b54adbad4f9c8a500be2e))

* Update points table ([`52c5ba4`](https://github.com/embeddings-benchmark/mteb/commit/52c5ba442788644b51bdc2f73f24e91d460c268b))

1.12.9

Fix

* fix: Add model implementations and script for running the models (845)

* delete existing model results

* fix: Added models implementations and script for running the models

Note there is still a few things missing due to a *very* poor internet connection

* Added loader to metadata obj

* Update revision

* Add e5 models

* Update mteb/models/e5_models.py

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com>

* Minor update on print

* tested that everything works

* formatted

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`b331c34`](https://github.com/embeddings-benchmark/mteb/commit/b331c340e8f48e5530c9c71003b252769a55cacb))

1.12.8

Fix

* fix: formatted ([`8d3fc1b`](https://github.com/embeddings-benchmark/mteb/commit/8d3fc1b0c6efa8e6cd31db6ab14884b080fb53ab))

Unknown

* Add abstention metrics to retrieval and reranking tasks (854)

* add abstention as retrieval/reranking metric

* add reviewer points

* update docstrings

* Update docs/mmteb/points/854.jsonl

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`53c477f`](https://github.com/embeddings-benchmark/mteb/commit/53c477fd0604f5afbf114a50c54bfe259a071be8))

1.12.7

Fix

* fix: Add Russian tasks (RU-MTEB) (815)

* add ru-mteb tasks

* add results for new tasks

* downsample classifcation tasks & remove validation splits

* update clustering tasks to fit size limit

* remove mmarco dataset

* minor changes

* add points

* add list of tasks to benchmarks ([`e9d61bb`](https://github.com/embeddings-benchmark/mteb/commit/e9d61bba729c0c50f4baa0aec3280ed94b116a96))

Unknown

* Update tasks table ([`eebf973`](https://github.com/embeddings-benchmark/mteb/commit/eebf9735fd165bad71695bb354b153d0625968c7))

* Update points table ([`cebf1fc`](https://github.com/embeddings-benchmark/mteb/commit/cebf1fc12c46c8e1764eb1d1abfd84195591371c))

Page 26 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.