Mteb

Latest version: v1.36.22

Safety actively analyzes 714815 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 17 of 82

1.26.6

Fix

* fix: Added zero shot tag to benchmark (1710)

* Added method for determining whether a model is zero shot

* Added .items() where intended

* Added filtering functions for zero shot models

* Added zero-shot filtering button and error message when table is empty.:

* Ran linting

* Fixed docstring linting error

* is_zero_shot returns None when no training data is specified

* Added zero-shot emoji column to leaderboard

* Added explanation for zero shot column

* Added soft and hard zero-shot buttons

* Added training data annotations to 24 models from HuggingFace Hub ([`8702815`](https://github.com/embeddings-benchmark/mteb/commit/87028155f1f4d0b81156e9ff278dcab8a903e7a4))

1.26.5

Ci

* ci: Refresh the v2 leaderboard daily (1711)

* Create leaderboard_refresh.yaml

* Shorten and fix

* factory reset instead of normal ([`25f4f61`](https://github.com/embeddings-benchmark/mteb/commit/25f4f618f1694d1155919c9771c551fa70b5049b))

Fix

* fix: rollback BUCC revision (1706)

* fix bucc
* fix logger
* upd evaluator
* add comment
* lint ([`9bcb52f`](https://github.com/embeddings-benchmark/mteb/commit/9bcb52ff6c6a13d3de03dc2f0cc95fd3a62d9170))

Unknown

* Fix: typos in adding a model (1722) ([`ab8805c`](https://github.com/embeddings-benchmark/mteb/commit/ab8805c612c178c30d6642770778b06324cbfbc1))

* Fix: minicpmv2 (1705)

* updmini cpm

* flash_attn implementation

* remove flash attn ([`222bb35`](https://github.com/embeddings-benchmark/mteb/commit/222bb35ebfa0da4d8b620d78bcfd64729a37ab03))

1.26.4

Fix

* fix: GermanDPR (1703)

* fix GermanDPR

* lint ([`753d08a`](https://github.com/embeddings-benchmark/mteb/commit/753d08a95dfdcdb3439510abff69e14304caa4e7))

* fix: Register MicroLlama Text Embedding (1644)

Register MicroLlama Text Embedding ([`6d1d9f4`](https://github.com/embeddings-benchmark/mteb/commit/6d1d9f4191876829740b9bf7234ec62d31805d30))

Unknown

* Update RerankingEvaluator.py (1702) ([`0753aba`](https://github.com/embeddings-benchmark/mteb/commit/0753abaacb31989e00b8e00322254cce85903639))

1.26.3

Fix

* fix: NanoBeir (1687)

* fix nano beir

* lint ([`cff7ed8`](https://github.com/embeddings-benchmark/mteb/commit/cff7ed887715f3f72c4de0793041c15205f87f04))

* fix: nomic prompts (1685)

* fix nomic prompts

* fix variable model name

* pass prompts to model

* use sentence transformer wrapper

* update prompts

* lint

* update prompts

* update list for classification ([`808257c`](https://github.com/embeddings-benchmark/mteb/commit/808257c0311cf5ff54cf579412a43eb460fbc15b))

1.26.2

Fix

* fix: update model loader to trust remote code (1697)

update model loader ([`43d74e1`](https://github.com/embeddings-benchmark/mteb/commit/43d74e158b6d3217e94e074b96ebe0649651ddf8))

1.26.1

Fix

* fix: add revision for jinaai/jina-embeddings-v2-small-en (1692)

add revision ([`6bfc1f2`](https://github.com/embeddings-benchmark/mteb/commit/6bfc1f2a5655c66940e4cb515153bb910498b9b6))

Unknown

* fix: add trust_remote_code to Snowflake/snowflake-arctic-embed-m-long (1695)

trust remote code ([`f4de307`](https://github.com/embeddings-benchmark/mteb/commit/f4de30737c6d862973a4512a33e5f1d269eea5af))

Page 17 of 82

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.