Mteb

Latest version: v1.36.22

Safety actively analyzes 714815 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 57 of 82

1.10.12

Fix

* fix: Add PublicHealthQA (750)

* Create new PublicHealthQA class and add to `mteb/tasks/Retrieval/__init__.py`

* Add retriever results

* Update metadata

* Update mteb/tasks/Retrieval/multilingual/PublicHealthQARetrieval.py

Co-authored-by: Wissam Siblini <36303760+wissam-sibusers.noreply.github.com>

* Update mteb/tasks/Retrieval/multilingual/PublicHealthQARetrieval.py

Co-authored-by: Wissam Siblini <36303760+wissam-sibusers.noreply.github.com>

* Update mteb/tasks/Retrieval/multilingual/PublicHealthQARetrieval.py

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

* Add contribution points

---------

Co-authored-by: Wissam Siblini <36303760+wissam-sibusers.noreply.github.com>
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`ca7266e`](https://github.com/embeddings-benchmark/mteb/commit/ca7266e6c81d8155a42d3532b725126c9c896a94))

Unknown

* Update tasks table ([`06862df`](https://github.com/embeddings-benchmark/mteb/commit/06862df1f452278d163a12595e893e93c38b5aba))

* Update points table ([`cb7a077`](https://github.com/embeddings-benchmark/mteb/commit/cb7a0776d486b812f17d5c9ffc83e7c4180f9061))

1.10.11

Fix

* fix: Quick fix CI/CD issue due to dataset redirect (761) ([`495d6f6`](https://github.com/embeddings-benchmark/mteb/commit/495d6f68efd4a4da7adb5dc8b4f5de6557c0c7e3))

Unknown

* Update tasks table ([`68f9cbc`](https://github.com/embeddings-benchmark/mteb/commit/68f9cbcf34f2c3b99cd3f83249439b9c7afefc74))

* Update points table ([`bf16840`](https://github.com/embeddings-benchmark/mteb/commit/bf16840f28f863c2cdb625ebed663a4dbe6aeba6))

* Adding FarsTail (Persian) for Pair Classification (736)

* Adding FarsTail (Persian) for Pair Classification
* change for entailment label
* adding points ([`c19db06`](https://github.com/embeddings-benchmark/mteb/commit/c19db06961f566e1946a3de2097890a0a686d209))

* Update points table ([`ff9c000`](https://github.com/embeddings-benchmark/mteb/commit/ff9c000e4e509543bca307934f2dccbba35a4c2d))

* add: Points for 697 (754)

* A follow up on https://github.com/embeddings-benchmark/mteb/pull/697

Signed-off-by: mr.Shu <mrshu.io> ([`7b20638`](https://github.com/embeddings-benchmark/mteb/commit/7b20638d29e039d97efe40c4820e4195d05487e1))

1.10.10

Fix

* fix: Convert Multilingual/Crosslingual to fast-loading format (635)

* STS

* DatasetDict for better compatibility

* IndicCrosslingualSTS

* MultiHateClassification

* subsetloader fix

* MultilingualSentimentClassification

* lint

* TweetSentimentClassification

* IndicSentimentClassification

* STSBenchmarkMultilingualSTS

* xnli

* fix readmes

* tests

* MasakhaNEWSClassification

* SIB200Classification

* MassiveIntentClassification

* MassiveScenarioClassification

* points

* support for parallel subsets

* missing subsets parameters

* bucc

* fixes

* Flores, IN22Conv, IN22Gen, NTREX

* lin

* BUCC and BUCC.v2

* lint

* tests

* points

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`aa82ada`](https://github.com/embeddings-benchmark/mteb/commit/aa82ada7b29826df0104193ddcc98cf7bb76c884))

Unknown

* Update tasks table ([`3b54004`](https://github.com/embeddings-benchmark/mteb/commit/3b540045c4548fadd78a1302f4c2fbc3581910a7))

* Update points table ([`3c7f7f4`](https://github.com/embeddings-benchmark/mteb/commit/3c7f7f451848c5dfca9036b50b5edf6dbd520a2f))

1.10.9

Fix

* fix: Convert WikiClustering to fast (745)

* add WikiClusteringFastP2P
* get task to work and run results
* add poionts
* bibtex
* points
* fix AbsTaskClusteringFast early return and rerun results
* points for bug fix
* refactor to be faster
---------
Co-authored-by: Márton Kardos <power.up1163gmail.com> ([`153827b`](https://github.com/embeddings-benchmark/mteb/commit/153827b022980ce9f454d1ef622f78e5856b0a77))

Unknown

* Update tasks table ([`393f001`](https://github.com/embeddings-benchmark/mteb/commit/393f001d24c662c056fa6ebd461a25d5f074a68b))

* Update points table ([`2a6e837`](https://github.com/embeddings-benchmark/mteb/commit/2a6e837660dc86b918ded0ef3e3cfd2060d2364b))

* Update tasks table ([`e2babab`](https://github.com/embeddings-benchmark/mteb/commit/e2bababd3038171d0a42a610a680360b03f83a23))

* add: SICK-BR (697)

* Add the Portugese version of the SICK dataset as an STS task.

* Add the Portugese version of the SICK dataset as a PairClassification task.

Signed-off-by: mr.Shu <mrshu.io>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`804b120`](https://github.com/embeddings-benchmark/mteb/commit/804b1200660eaf7674f8390590f11f65058192bb))

1.10.8

Fix

* fix: Add new dataset: GermanGovServiceRetrieval (731)

* Add new dataset: GermanGovServiceRetrieval

* points for GermanGovServiceRetrieval; changed main metric

* Update docs/mmteb/points/731.jsonl

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`66792ef`](https://github.com/embeddings-benchmark/mteb/commit/66792efbfc12cc43df87ab17684f5202775ff253))

Unknown

* Update tasks table ([`e8dd8af`](https://github.com/embeddings-benchmark/mteb/commit/e8dd8aff8a227f9f042dda4319e607f48bf5d70c))

* Update points table ([`904c039`](https://github.com/embeddings-benchmark/mteb/commit/904c039433e30f5a7b333737d8c492f16f754c27))

1.10.7

Fix

* fix: Convert Reddit cluster s2s and p2p to fast (729)

* reddit cluster s2s to fast
* got task running and add results
* rerun with 16k samples
* full reddit cluster s2s
* filter out labels and result runs
* points
* make lint
* validation ([`b02f252`](https://github.com/embeddings-benchmark/mteb/commit/b02f252c707bce6de61af56ca3b5d7e921f6ef09))

Unknown

* Update tasks table ([`6745475`](https://github.com/embeddings-benchmark/mteb/commit/67454756dc0d872f9b829f61c04bbf866f66ee19))

* Update points table ([`a416bd1`](https://github.com/embeddings-benchmark/mteb/commit/a416bd1e22b0dba5757b44035da1a6b813b4a116))

Page 57 of 82

Links

Releases

Has known vulnerabilities

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.