Mteb

Latest version: v1.34.14

Safety actively analyzes 706267 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 29 of 75

1.14.1

Fix

* fix: removed test set for AFQMC with no gold labels (1153)

The test set of AFQMC is hidden so has removed it from the default suite. This influences the C-MTEB. Who is the best person to contact for this? (Muennighoff) ([`14cff3e`](https://github.com/embeddings-benchmark/mteb/commit/14cff3e7830150e28b45098a008048189c7d1e1e))

Unknown

* Fix: llm2vec for retrieval (1152)

* fix: remove kwargs LLM2Vec doesn&39;t have

* fix: linter error

* fix: an item automatically added by linter ([`d1794cd`](https://github.com/embeddings-benchmark/mteb/commit/d1794cd2edaf9236699d6d1ccba4cbc15b5f8708))

1.14.0

Feature

* feat: Cleaned up scripts folder (1144)

* fix: Move benchmarks from script to benchmarks.py

- A few of the benchmarks weren&39;t implemented in the benchmark list. The best choice seem to move them benchmarks and remove the script (there were already a few issues). To ensure that they are maintained with the rest.
- Removed trivial (e.g. running one task) or outdated examples. Removing them ensure that we have less to maintain.
- moved mteb specific script into a mteb-folder.

* format

* fix: Convert arbitrary imports to absolute imports. (1145)

This avoids loading in classes as modules (see PR ...)

* restructe scripts folder ([`ebe6def`](https://github.com/embeddings-benchmark/mteb/commit/ebe6defb6942e7e98edcece6eb8be9820ce7899a))

1.13.2

Fix

* fix: Remove unused tests (1148)

These tests are no longer used since results moved to the results repo. ([`28f592f`](https://github.com/embeddings-benchmark/mteb/commit/28f592f2289b31d8de5e49b76a49e19f94810ebc))

Unknown

* Update tasks table ([`8560d9f`](https://github.com/embeddings-benchmark/mteb/commit/8560d9fb4bec43e584540b0d1642b02cfd449c44))

* Missing import for SadeemQuestionRetrieval (1146)

Fixes 1143 ([`3b6e27d`](https://github.com/embeddings-benchmark/mteb/commit/3b6e27d6c0c58c2624c2f3cb40e30f8f20fea39d))

* Simplify models (1118)

* Merge

* Adapt

* Simplify

* Check for rev again

* Rmv cmmnt

* Simplify

* simplify

* Rmv comment

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Use logging; change try except; add info

* Lint

* Rmv results

* Update rev

* Simplify models; Allow instructions

* Jobs

* Fix merge

* Format

* Adapt models

* Fix task types

* Update

* Fix syntax

* Simplify

* Add comparison

* Format

* Fix double comment

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Move example

* Format

* Rmv outdated instructions

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`79c1a42`](https://github.com/embeddings-benchmark/mteb/commit/79c1a420f62716c2dfd1284185d5f35c630e0f47))

1.13.1

Fix

* fix: add CoIR as Benchmark (1142)

* add CoIR as Benchmark

* lint ([`1b80fce`](https://github.com/embeddings-benchmark/mteb/commit/1b80fcebd3a8f1f4b4347895cc8c84b181f1c31c))

1.13.0

Feature

* feat: Added in functionality to allow loading outdated results (1141) ([`d76e686`](https://github.com/embeddings-benchmark/mteb/commit/d76e6868e5cdf04ed790f9fd04d046e15f798fcc))

1.12.94

Fix

* fix: add CoIR tasks (1130)

* add CoIR tasks

* change to mteb datasets ([`aa97e39`](https://github.com/embeddings-benchmark/mteb/commit/aa97e3931494e9c68aab47345003b47e1933ad3b))

Unknown

* Update tasks table ([`e9a3ce8`](https://github.com/embeddings-benchmark/mteb/commit/e9a3ce8c84dc63152dbd8051e2d8e6dc753c3a2f))

* Update points table ([`76e2bff`](https://github.com/embeddings-benchmark/mteb/commit/76e2bffa77e85205cd0cac6fc4fde9218bec73ae))

* Added pyupgrade (using ruff) to lint CI (1137)

* Added pyupgrade (using ruff) to lint CI
* Added FA ruleset
* Added C4 ruleset for simplifying comprehensions
* Added a few exceptions for points
Co-authored-by: bryant1410 <nameexample.com>
* Added required import
* Add co-author
Co-authored-by: bryant1410 <bryant1410gmail.com>
* format
---------
Co-authored-by: bryant1410 <nameexample.com>
Co-authored-by: bryant1410 <bryant1410gmail.com> ([`e4afd0e`](https://github.com/embeddings-benchmark/mteb/commit/e4afd0ee871cb641ac67661c08c831b4f8f0bca0))

Page 29 of 75

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.