Mteb

Latest version: v1.34.14

Safety actively analyzes 706267 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 17 of 75

1.21.2

Fix

* fix: Task load data error for SICK-BR-STS and XStance (1534)

* fix task load data for two tasks

* correct dataset keys ([`5b6f20f`](https://github.com/embeddings-benchmark/mteb/commit/5b6f20fe6fbe7673480fbb8c36402ddbe7e203a2))

1.21.1

Fix

* fix: Correct typos superseeded -> superseded (1532)

fix typo -> superseded ([`343b6e0`](https://github.com/embeddings-benchmark/mteb/commit/343b6e055f1fe6784f3fcf9d99e830101bb3e16f))

1.21.0

Feature

* feat: Evaluate missing splits (1525)

* fix: evaluate missing splits (1268)

* implement partial evaluation for missing splits

* lint

* requested changes done from scratch

* test for missing split evaluation added

* uncomment test

* lint

* avoid circular import

* use TaskResult

* skip tests for now

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

* got test_all_splits_evaluated passing

* tests passing

* address review comments

* make lint

* handle None cases for kg_co2_emissions

* use new results info

---------

Co-authored-by: Thivyanth <thivyanth2004gmail.com> ([`8e12250`](https://github.com/embeddings-benchmark/mteb/commit/8e1225047d4eed79484c00440fe3f801c512eca5))

1.20.6

Fix

* fix: Adding missing metadata on models and mathcing names up with the results repo (1528)

* Added Voyage 3 models

* Added correct metadata to Cohere models and matched names with the results repo ([`b02ae82`](https://github.com/embeddings-benchmark/mteb/commit/b02ae826bd512d8c28afb185fa856ca76e90fc0b))

1.20.5

Documentation

* docs: Add lang family mapping and map to task table (1486)

* add lang family mapping and map to task table

* make lint

* add back some unclassified lang codes ([`cfd43ac`](https://github.com/embeddings-benchmark/mteb/commit/cfd43aca70173b93a4d1163b1e6afd52eef41372))

Fix

* fix: Ensure that models match the names on embedding-benchmarks/results (1519) ([`e3d2b54`](https://github.com/embeddings-benchmark/mteb/commit/e3d2b548d8df716bd5ab8ef4f080d7cff82d51cf))

Unknown

* Update tasks table ([`377a63d`](https://github.com/embeddings-benchmark/mteb/commit/377a63d01e19d42d1163c9cc92b26a11ca84bf5d))

1.20.4

Fix

* fix: align readme with current mteb (1493)

* align readme with current mteb

* align with mieb branch

* fix test ([`942f212`](https://github.com/embeddings-benchmark/mteb/commit/942f2125dce5534a167416eefe322dcc71dcbcfe))

Page 17 of 75

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.