Mteb

Latest version: v1.36.35

Safety actively analyzes 723685 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 27 of 85

1.20.4

Fix

* fix: align readme with current mteb (1493)

* align readme with current mteb

* align with mieb branch

* fix test ([`942f212`](https://github.com/embeddings-benchmark/mteb/commit/942f2125dce5534a167416eefe322dcc71dcbcfe))

1.20.3

Fix

* fix: leaderboard only shows models that have ModelMeta (1508)

Filtering for models that have metadata ([`35245d3`](https://github.com/embeddings-benchmark/mteb/commit/35245d36248c0105accaace879f4662def52f5c0))

1.20.2

Fix

* fix: Leaderboard demo data loading (1507)

* Made get_scores error tolerant

* Added join_revisions, made get_scores failsafe

* Fetching metadata fixed fr HF models

* Added failsafe metadata fetching to leaderboard code

* Added revision joining to leaderboard app

* fix

* Only show models that have metadata, when filter_models is called

* Ran linting ([`0affa31`](https://github.com/embeddings-benchmark/mteb/commit/0affa31c23727889f56f4bb27da9154ce13ed67a))

1.20.1

Fix

* fix: check if `model` attr of model exists (1499)

* check if model attr of model exists

* lint

* Fix retrieval evaluator ([`917ad7f`](https://github.com/embeddings-benchmark/mteb/commit/917ad7f23704edc974c407efda20edc71375041d))

1.20.0

Feature

* feat: add CUREv1 retrieval dataset (1459)

* feat: add CUREv1 dataset

---------

Co-authored-by: nadshe <nadia.sheikhclinia.com>
Co-authored-by: olivierr42 <olivier.rousseauclinia.com>
Co-authored-by: Daniel Buades Marcos <danielbuad.es>

* feat: add missing domains to medical tasks

* feat: modify benchmark tasks

* chore: benchmark naming

---------

Co-authored-by: nadshe <nadia.sheikhclinia.com>
Co-authored-by: olivierr42 <olivier.rousseauclinia.com> ([`1cc6c9e`](https://github.com/embeddings-benchmark/mteb/commit/1cc6c9e0fe62ca4e77708b641823fa1a121f048b))

Unknown

* Update tasks table ([`4408717`](https://github.com/embeddings-benchmark/mteb/commit/440871739689a175d0e4a8c538ce428a4e27e350))

1.19.10

Documentation

* docs: Add sum per language for task counts (1468)

* add sum per lang

* add sort by sum option

* make lint ([`2fb6fe7`](https://github.com/embeddings-benchmark/mteb/commit/2fb6fe764585f0cf6555d15ba9b2e18d4adddcf3))

Fix

* fix: pinned datasets to <3.0.0 (1470) ([`fde124a`](https://github.com/embeddings-benchmark/mteb/commit/fde124a8a0894838aabca90b061191e74c33a82f))

Page 27 of 85

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.