Mteb

Latest version: v1.36.22

Safety actively analyzes 714815 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 50 of 82

1.12.15

Documentation

* docs: Affiliation modification (871)

modified affiliation

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`6e43bbf`](https://github.com/embeddings-benchmark/mteb/commit/6e43bbf389b8c71e1d15b50054a0183789d6c580))

Fix

* fix: Add MIRACL reranking (830)

* fix: MIRACL reranking (641)

* miracl reranking

* clean

* reranking eval based on pytrec

* eval miracl-reranking using pytrec

* miracl reranking

* dataset name

* compute_metrics_batched

* dataset name typo

* clean

* make lint

* points

* Update mteb/evaluation/evaluators/RerankingEvaluator.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/evaluation/evaluators/RerankingEvaluator.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/evaluation/evaluators/RerankingEvaluator.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/tasks/Reranking/multilingual/MIRACLReranking.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* solve part of PR comments

* docstring

* n-samples and avg_char_length

* make lint

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Addressed changes from main PR

* remove unused import

* removed abstract from citation

* added *(MIRACL) to results

* fix: Miracl reranking fix (870)

* change evaluate and evaluate_custom back to staticmethod

* using MIRACLRerankingEvaluator rather than RerankingEvaluator; adapt to latest RetrievalEvaluator

* formatted

* fix: fixed missing references

---------

Co-authored-by: Crystina Xinyu Zhang <x978zhanuwaterloo.ca>
Co-authored-by: Your Name <youexample.com> ([`4218675`](https://github.com/embeddings-benchmark/mteb/commit/421867588007e7664a1584e3f273d2978b3bade1))

Unknown

* Update tasks table ([`2291242`](https://github.com/embeddings-benchmark/mteb/commit/2291242b8c3e99f84826adf43a427e9e42dd8f4e))

* Update points table ([`77badee`](https://github.com/embeddings-benchmark/mteb/commit/77badee59c439d537486317fd490ed801c441108))

1.12.14

Fix

* fix: dataset not available (872)

fix dataset not available ([`397519b`](https://github.com/embeddings-benchmark/mteb/commit/397519b4aea562dc2912d49874ec819550f2e28f))

1.12.13

Fix

* fix: main score for longEmbed (869)

* Fix main score

* Fix main score ([`db8bb5e`](https://github.com/embeddings-benchmark/mteb/commit/db8bb5ecaa6f5038cb090aba224461ab20015741))

1.12.12

Fix

* fix: Updated the revision of dataset (866)

* Updated the revision of dataset

* Updated the test results ([`e48eef9`](https://github.com/embeddings-benchmark/mteb/commit/e48eef9457b246adaba5e16064c425374d78dad8))

1.12.11

Documentation

* docs: removed spacing is github user name ([`facdb76`](https://github.com/embeddings-benchmark/mteb/commit/facdb7653cd14e92dfe853da6054e8fa0f7247bb))

Fix

* fix: Convert MLSUM to fast (865)

* add MLSUMClusteringS2S.v2

* add e5 results

* add MLSUMClusteringS2SFast

* points

* make lint

* review ([`b70bb5a`](https://github.com/embeddings-benchmark/mteb/commit/b70bb5afd808b7a46094029ab07604a08fbd7356))

Unknown

* Update tasks table ([`d3413b9`](https://github.com/embeddings-benchmark/mteb/commit/d3413b9d48f088132aa36d90dcb892d9db160aa0))

* Update points table ([`4ebc68a`](https://github.com/embeddings-benchmark/mteb/commit/4ebc68af640ea54ebcf55430596bbd6c4faa9582))

* Update points table ([`bad247a`](https://github.com/embeddings-benchmark/mteb/commit/bad247afaefc3ba8a6b8ab36376a24cdd36504cc))

1.12.10

Fix

* fix: add check_label_distribution for ClusteringFast (862)

* check_label_distribution and results

* make lint

* points

* correct validation ([`6afb8a9`](https://github.com/embeddings-benchmark/mteb/commit/6afb8a9b923e59a32affd6ca3671d257387ce086))

Unknown

* Update tasks table ([`a2ad6ef`](https://github.com/embeddings-benchmark/mteb/commit/a2ad6efb903e1611c18b54adbad4f9c8a500be2e))

* Update points table ([`52c5ba4`](https://github.com/embeddings-benchmark/mteb/commit/52c5ba442788644b51bdc2f73f24e91d460c268b))

Page 50 of 82

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.