Mteb

Latest version: v1.36.22

Safety actively analyzes 714815 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 6 of 82

1.34.26

Fix

* fix: Upgrade ruff to be gradio compatible (2111)

* fix: update ruff to be gradio compatible (>=0.9.3)

* format

* fix: upgrade ruff to latests (same as gradio compatible) ([`fb14e0c`](https://github.com/embeddings-benchmark/mteb/commit/fb14e0c652e06d5c730856d9e6ed2769bcd4d223))

1.34.25

Fix

* fix: add training data to BGE-m3-custom-fr (2110)

This ensure that is it correctly filtered as non-zero-shot ([`cb42f4a`](https://github.com/embeddings-benchmark/mteb/commit/cb42f4a5cfa0a62fe89b6d8da00b5e27c94cb072))

1.34.24

Fix

* fix: Add codesage-large-v2 (2090)

* Add codesage-large-v2

* Address comments

* Add training dataset

* Fix issues

* Format code

* Remove unnecessary wrapper ([`c052bbb`](https://github.com/embeddings-benchmark/mteb/commit/c052bbb98a826ce2da35859178a2868620afa61d))

1.34.23

Documentation

* docs: Fix typos & refine text (2102)

* Update app.py

* Fix typos ([`caa0b77`](https://github.com/embeddings-benchmark/mteb/commit/caa0b77e4c21310a64f480cbd710c62810deb134))

Fix

* fix: add warning about task category conversion (2108)

add warning about task category conversion ([`6a71485`](https://github.com/embeddings-benchmark/mteb/commit/6a714858e75a2a8fd2ec749c0ebe8866fe234037))

Unknown

* Update tasks table ([`6e0c87a`](https://github.com/embeddings-benchmark/mteb/commit/6e0c87a4d484124ce81096419cdd0427823bde28))

* misc: Run Zeroshot Classification Descriptive Stats (2105)

* add most datasets

* add birdsnap and imgnet1k

* add scimmir and sun397

* add uck101 zs ([`56a7b1a`](https://github.com/embeddings-benchmark/mteb/commit/56a7b1ae78709bdfe108da88d65acfc08cdae78d))

* Add model inf-retriever-v1-1.5b (2106)

Add inf-retriever-v1-1.5b model ([`c69b8c3`](https://github.com/embeddings-benchmark/mteb/commit/c69b8c318390d294f979b1add1c68186ec4b8355))

1.34.22

Fix

* fix: Update links (2098)

* Fix link

* Fix link ([`6b9f945`](https://github.com/embeddings-benchmark/mteb/commit/6b9f945183ceb01c7bc330fe9cddc132491012fb))

* fix: Updated model annotations for GTE, e5, gritlm, and SFR models (2101)

Reported with references to paper + qoutes. ([`e0b364b`](https://github.com/embeddings-benchmark/mteb/commit/e0b364b5961e392e7662bfab9bf5ddb460b4943f))

Unknown

* Update tasks table ([`9ca55f0`](https://github.com/embeddings-benchmark/mteb/commit/9ca55f055943c44cadf654d6b49cc67b88b45d3d))

* misc: Add Any2TextMutipleChoice Descriptive Statistics (2095)

* add Any2TextMutipleChoiceDescriptiveStatistics

* run on all tasks ([`0371102`](https://github.com/embeddings-benchmark/mteb/commit/0371102c5288cf7246d990db42d3d129aa1af02a))

* Added gtr-t5-base/large/xl/xxl metadata to mteb (2092)

* Added GTR Models to codebase

* Linted gtr models file.

* Added gtr-base/large/xl/xxl to sentence_transformers_models.py

* Added memory_usage_mb and training_datasets

* Reformatted training dataset names

* Reformatted training dataset names

* Reformatted training dataset names

---------

Co-authored-by: sufen <sufenfgmail.com> ([`bbfbc45`](https://github.com/embeddings-benchmark/mteb/commit/bbfbc45a168cf7617d10c021d97b5beafde04dc1))

1.34.21

Fix

* fix: Add back task filtering by modalities (2080)

* add back task filtering by modalities

* add unit test

* check if task modalities is a subset of model modalities and fix tests

* add model_modalities_more_than_task_modalities case ([`3deb7ea`](https://github.com/embeddings-benchmark/mteb/commit/3deb7eaf3d57752f625abf26d561b45ab0c47d98))

Unknown

* merge gme models (2089) ([`1b1d327`](https://github.com/embeddings-benchmark/mteb/commit/1b1d327ee62eaea7a2ff44b9f1a16039a77e208d))

Page 6 of 82

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.