Mteb

Latest version: v1.34.22

Safety actively analyzes 707268 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 77

1.34.22

Fix

* fix: Update links (2098)

* Fix link

* Fix link ([`6b9f945`](https://github.com/embeddings-benchmark/mteb/commit/6b9f945183ceb01c7bc330fe9cddc132491012fb))

* fix: Updated model annotations for GTE, e5, gritlm, and SFR models (2101)

Reported with references to paper + qoutes. ([`e0b364b`](https://github.com/embeddings-benchmark/mteb/commit/e0b364b5961e392e7662bfab9bf5ddb460b4943f))

Unknown

* Update tasks table ([`9ca55f0`](https://github.com/embeddings-benchmark/mteb/commit/9ca55f055943c44cadf654d6b49cc67b88b45d3d))

* misc: Add Any2TextMutipleChoice Descriptive Statistics (2095)

* add Any2TextMutipleChoiceDescriptiveStatistics

* run on all tasks ([`0371102`](https://github.com/embeddings-benchmark/mteb/commit/0371102c5288cf7246d990db42d3d129aa1af02a))

* Added gtr-t5-base/large/xl/xxl metadata to mteb (2092)

* Added GTR Models to codebase

* Linted gtr models file.

* Added gtr-base/large/xl/xxl to sentence_transformers_models.py

* Added memory_usage_mb and training_datasets

* Reformatted training dataset names

* Reformatted training dataset names

* Reformatted training dataset names

---------

Co-authored-by: sufen <sufenfgmail.com> ([`bbfbc45`](https://github.com/embeddings-benchmark/mteb/commit/bbfbc45a168cf7617d10c021d97b5beafde04dc1))

1.34.21

Fix

* fix: Add back task filtering by modalities (2080)

* add back task filtering by modalities

* add unit test

* check if task modalities is a subset of model modalities and fix tests

* add model_modalities_more_than_task_modalities case ([`3deb7ea`](https://github.com/embeddings-benchmark/mteb/commit/3deb7eaf3d57752f625abf26d561b45ab0c47d98))

Unknown

* merge gme models (2089) ([`1b1d327`](https://github.com/embeddings-benchmark/mteb/commit/1b1d327ee62eaea7a2ff44b9f1a16039a77e208d))

1.34.20

Fix

* fix: Missing fixes for 2086 - change MultilingualSentiment split from test to validation in CMTEB (2088)

* fix: Fixed previous incorrect specification of splits for CMTEB ( MTEB(cmn, v1) )

Fixes 2064

* change MultilingualSentiment split from test to validation in CMTEB ([`6637ff9`](https://github.com/embeddings-benchmark/mteb/commit/6637ff95945b12a61594d09eafe88c82d3dfe4e4))

* fix: Smarter leaderboard caching with cachetools (2085)

* Added smarter caching to callbacks

* Added cachetools as a dependency

* Ran linting

* Removed debugging print statement

* Bumped Gradio version

* Dependency fixes

* Dependency fixes

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`1006770`](https://github.com/embeddings-benchmark/mteb/commit/1006770c098869d5c9db2e1b3b13c2c190c34a26))

Unknown

* Remove duplicated string in docstring of TaskMetadata class (2087)

* Remove duplicated string in docstring of TaskMetadata class

* Remove duplicated dataset field ([`c6e5123`](https://github.com/embeddings-benchmark/mteb/commit/c6e51230a9a65b9e5c25bae54e8d4b2c8095c7f8))

1.34.19

Fix

* fix: Fixed previous incorrect specification of splits for CMTEB ( MTEB(cmn, v1) ) (2086)

Fixes 2064 ([`12d9b96`](https://github.com/embeddings-benchmark/mteb/commit/12d9b96842d64a159dba39013b2a121e7b436f9b))

1.34.18

Fix

* fix: Freeze model/rank columns in leaderboard (2044)

* fix: freeze model/rank columns in leaderboard

* freezing zero-shot column

* update min gradio version to 5.16.0 in pyproject.toml

---------

Co-authored-by: Shikhar Shiromani <sshiromanisshiromani-mlt.client.nvidia.com> ([`07562f4`](https://github.com/embeddings-benchmark/mteb/commit/07562f4d27c8319249c2a28ff9903ad5bf3b4173))

1.34.17

Fix

* fix: Ensure voyage model uses different naming scheme (2083)

* fix: Added make command for running leaderboard locally

* fix: Ensure voyage models doesn&39;t re-use the name ([`b14963f`](https://github.com/embeddings-benchmark/mteb/commit/b14963fe6ace93ca9c1e7e066577f7e44250f823))

Page 1 of 77

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.