Mteb

Latest version: v1.36.35

Safety actively analyzes 723799 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 85

1.36.23

Fix

* fix: Reduce logging and Warnings (2349)

* Reduce logging and Warnings

* make lint

* format license to lowercase

* Address all comments

* Update mteb/leaderboard/app.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

---------

Co-authored-by: Roman Solomatin <samoed.romangmail.com> ([`99eb94b`](https://github.com/embeddings-benchmark/mteb/commit/99eb94beed6156fe1efa6af87925de31cbc7077f))

Unknown

* fix leaderboard (2385) ([`1bd844f`](https://github.com/embeddings-benchmark/mteb/commit/1bd844f4cf9d7abe01dc0091ca54844cc7562e71))

* Correct -1 to No information in Zero shot (2381) ([`6fddbb0`](https://github.com/embeddings-benchmark/mteb/commit/6fddbb0bb929c5b42af14e9b7660bd1f49629bc1))

* Update tasks table ([`f31dc32`](https://github.com/embeddings-benchmark/mteb/commit/f31dc32b55ba0d72e8e10f9fab3dad226e137303))

* correct MIEB dataset stats (2374)

* correct stats

* update Any2AnyMultiChoice qrels stats compute logic

* final correction ([`773211b`](https://github.com/embeddings-benchmark/mteb/commit/773211bb4ece58abc8bb6b1bbbf97bccf35b1559))

* Rename dunzhang and Jasper models to NovaResearch (2373)

* Rename dunzhang and Jasper models to NovaResearch

* rename model in tests

* correct reference link ([`e34b139`](https://github.com/embeddings-benchmark/mteb/commit/e34b1394a4b5386675313f5177ca9a52213699d5))

* add-Data Korean Clustering dataset (KLUE-modified) (2283)

* add PatentFnBClustering.py

* do make lint and revise

* rollback Makefile

* Update mteb/tasks/Clustering/kor/PatentFnBClustering.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* klue_mrc_domain

* make lint

* klue_modified_clustering_dataset

---------

Co-authored-by: Roman Solomatin <samoed.romangmail.com> ([`efeb1c9`](https://github.com/embeddings-benchmark/mteb/commit/efeb1c9b75fa3392cb09efa9ef9baf5a74e21525))

1.36.22

Fix

* fix: Ensure MIRACL pass trust_remote_code (2346)

* fix: Add `trust_remote_code` to MIRACLRetrieval

* fix: Correctly pass trust remote code to Miracl

* fix ([`75961a0`](https://github.com/embeddings-benchmark/mteb/commit/75961a0d0b47fc2305cf0cdd6bc9dbe54db489e9))

* fix: Correctly pass trust remote code to Miracl ([`d6d8552`](https://github.com/embeddings-benchmark/mteb/commit/d6d8552c664ec530eb4ea87fa4d35d8a57c8bfef))

Unknown

* Merge branch &39;main&39; of https://github.com/embeddings-benchmark/mteb ([`eadc38d`](https://github.com/embeddings-benchmark/mteb/commit/eadc38d27930d1c90f9c1586d0f26c3138405071))

* Merge branch &39;fix-miracl&39; ([`7576b57`](https://github.com/embeddings-benchmark/mteb/commit/7576b572921100cd878558a45f98977ad86270a0))

1.36.21

Fix

* fix: Add `trust_remote_code` to MIRACLRetrieval (2344) ([`2d45653`](https://github.com/embeddings-benchmark/mteb/commit/2d4565308329e64d56db5486302791e1bf59da30))

1.36.20

Fix

* fix: Add WebFAQ bitext mining tasks (2326)

* Add WebFAQ bitext mining tasks

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de>

* Lower number of language pairs in WebFAQBitextMining

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de>

---------

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de> ([`04cfe4d`](https://github.com/embeddings-benchmark/mteb/commit/04cfe4df42fb60804d61945ddef8bcfbaac9e065))

Unknown

* Update tasks table ([`d716408`](https://github.com/embeddings-benchmark/mteb/commit/d7164082ec0b88c6186d43a8f4262f8b5c94fab4))

1.36.19

Documentation

* docs: fix typos ([`849efbb`](https://github.com/embeddings-benchmark/mteb/commit/849efbb0126f1471bf1ee15b5c9ab54711ff94e2))

Fix

* fix: Add ModelMeta rubert-mini-frida, BERTA (2330)

* Add rubert-mini-frida model meta

* Add BERTA model meta ([`ae83b5f`](https://github.com/embeddings-benchmark/mteb/commit/ae83b5f4b67790f07ba6c5bd9a21f7c893b63292))

1.36.18

Fix

* fix: add annotation models for stella zh (2277)

* fix: add annotation models for stella zh

Additionally fixed a few annotation errors

* format

* Update mteb/models/stella_models.py

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`034da4d`](https://github.com/embeddings-benchmark/mteb/commit/034da4d7ebc9a01b549355d1717e734560cc2c13))

Page 3 of 85

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.