Mteb

Latest version: v1.36.35

Safety actively analyzes 723954 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 85

1.36.29

Fix

* fix: Major updates to docs + make mieb dep optional (2397)

* fix: renaming Zeroshot -> ZeroShot

Adresses 2078

* fix: minor style changes

Adresses 2078

* fix: Major updates to documentation

This PR does the following:
- This introduced other modalities more clearly in the documentation as well as make it easier to transition to a full on documentation site later.
- added minor code updates due to discovered inconsistencies in docs and code.
- Added the MMTEB citation where applicable
- makes the docs ready to move torchvision to an optional dependency

* Moved VISTA example

* rename 1

* rename 2

* format

* fixed error

* fix: make torchvision optional (2399)

* fix: make torchvision optional

* format

* add docs

* minor fix

* remove transform from Any2TextMultipleChoiceEvaluator

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

* move Running SentenceTransformer model with prompts to usage

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`cae1575`](https://github.com/embeddings-benchmark/mteb/commit/cae157558e984c8dd6472e0b65df786b8cd217ae))

Unknown

* Update tasks table ([`5b0bd56`](https://github.com/embeddings-benchmark/mteb/commit/5b0bd56748be08be89b569e680b842d27a66b95a))

* Added new dataset and tasks - ClusTREC-covid , clustering of thematic covid related scientific papers (2302)

* Clustrec covid new dataset and task

* fix

* fix

* fix

* fix

* fix

* descriptive stats

* change all mentions of clustrec-covidp2p to clustrec-covid

* change &39; to &34; ([`e2476d2`](https://github.com/embeddings-benchmark/mteb/commit/e2476d2644e2753cf0671f3b221032a452ab906e))

* Minor style changes (2396)

* fix: renaming Zeroshot -> ZeroShot

Adresses 2078

* fix: minor style changes

Adresses 2078

* rename 1

* rename 2

* format

* fixed error

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`8be95b7`](https://github.com/embeddings-benchmark/mteb/commit/8be95b78c6de0023d0429bb0af4ffc4b202584cf))

1.36.28

Fix

* fix: Update AmazonPolarityClassification license (2402)

Update AmazonPolarityClassification.py ([`cf84a79`](https://github.com/embeddings-benchmark/mteb/commit/cf84a79085c1499235c519d5fb913019870c060e))

Unknown

* fix b1ade name (2403) ([`a0990cb`](https://github.com/embeddings-benchmark/mteb/commit/a0990cb21dd77583ca5a283c262ce08cfb7759d3))

1.36.27

Fix

* fix: renaming Zeroshot -> ZeroShot (2395)

* fix: renaming Zeroshot -> ZeroShot

Adresses 2078

* rename 1

* rename 2

* format

* fixed error ([`e7b04a6`](https://github.com/embeddings-benchmark/mteb/commit/e7b04a67c0c4010753c5f4bd0efa0d3e8aa21865))

Unknown

* Pass task name to all evaluators (2389)

* pass task name to all tasks

* add test

* fix loader ([`5ebee24`](https://github.com/embeddings-benchmark/mteb/commit/5ebee24e2d4718287c8b485565b3798df2f14c80))

1.36.26

Fix

* fix: Ensure BrightRetrieval is valid to run (2334)

* fix: Ensure BrightRetrieval is valid to run

Not sure this is the best way to fix this. Let me know if you can find a better fix.

fixes 2327

* fix: convert brightretrieval to two tasks

* fix collecting error ([`cf26764`](https://github.com/embeddings-benchmark/mteb/commit/cf26764f62efbf62c6bdac3bc545a75166de8d85))

Unknown

* Update tasks table ([`042d6e7`](https://github.com/embeddings-benchmark/mteb/commit/042d6e7fd4c797e461ad78901d27f16de91daf95))

1.36.25

Fix

* fix: pin gradio dependency to ensure leaderboards works (2387) ([`43b5b69`](https://github.com/embeddings-benchmark/mteb/commit/43b5b69fe85c6ed99e0843fc1bac465391c1d471))

1.36.24

Fix

* fix: b1ade (2386)

* fix: added b1ade_models.py (2340)

* added b1ade_models.py

* changing based on requested

* Update mteb/models/b1ade_models.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* fix: missing import and formatting

---------

Co-authored-by: Shreyas Subramanian <shreyas.f117gmail.com> ([`60c0a75`](https://github.com/embeddings-benchmark/mteb/commit/60c0a750454a2d920158a6d135ac2950bb8f8412))

Page 2 of 85

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.