Mteb

Fix

* fix: Update DanFever to use avoid using overwrite=True and ignore identical ids (994)

* fix: Updated DanFever to use avoid using overwrite=True and ignore identical ids

* fix: Updated logging, adding utility helper when specifying the wrong task and added --overwrite flag to CLI

* fix: revert changes to danFEVER

* fixed spelling of superseeded_by > superseded_by ([`56ba2d7`](https://github.com/embeddings-benchmark/mteb/commit/56ba2d7657976180ef95d83eec9743de851c5542))

Unknown

* Update points table ([`976d921`](https://github.com/embeddings-benchmark/mteb/commit/976d921a0600cbe4ef42ba357ca4f3d39e491221))

* Fix identical query-corpus ids in retrieval tasks (918)

* Fix bug: identical query-corpus ids

* Add results

* Make device argument optional in Encoder

* add points ([`7c50e59`](https://github.com/embeddings-benchmark/mteb/commit/7c50e59caf055bcd3cb064ddd9476a10fd2c3b08))

Fix

* fix: convert scores in meta to be in 0-100 instead of 0-1 (993)

fix: convert scores in meta to be expressed in 0-100 instead of 0-1 ([`870a2d9`](https://github.com/embeddings-benchmark/mteb/commit/870a2d9417127dfacc18f42943af46a97c2b90e0))

Unknown

* Update tasks table ([`694bbd9`](https://github.com/embeddings-benchmark/mteb/commit/694bbd9b3f2191c8e97d7ae66031808f180dd507))

* Update numbers in retrieval statistics (988)

* example

* fix validation error

* add retrieval task info

* lint

* remove task_name key

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`10c3fbf`](https://github.com/embeddings-benchmark/mteb/commit/10c3fbf25590e97f0c26f6068d261a222d59ad33))

Fix

* fix: Add Nomic and Multilingual Cohere (987)

* Add nomic and cohere models

* format

* Ensure that models run on a sample task and reproduce results on SEB

* Added normalization to encode

* fix naming variable

* Update mteb/evaluation/evaluators/model_encode.py

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com>

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`e398f20`](https://github.com/embeddings-benchmark/mteb/commit/e398f2012c189da1a88d18e9b9bc0e87882c675d))

Unknown

* Add BGE large en v1.5 (986)

* add models
* make lint
* correct naming
* does not need as Jina works out of the box with ST
* pop prompt_name
* add normalize_embeddings=True
* make lint ([`d5e8bd1`](https://github.com/embeddings-benchmark/mteb/commit/d5e8bd114f8e76da6cd0eefa8ec43ee1b0218978))

Fix

* fix: Update Retrieval Statistics Checker (985)

* changes to retrieval stats

* lint

* Update mteb/abstasks/AbsTaskRetrieval.py

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

* make print functions nicer

* add print and tqdm

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`230c311`](https://github.com/embeddings-benchmark/mteb/commit/230c3110f5dbee38ebd45425973cb262defac3fc))

Fix

* fix: Add MIRACL retrieval (833)

* Adding MIRACL Retrieval (642)

* added initial MIRACL Retrieval for yoruba

* updated langs to take self.langs

* make lint

* update points

* change the explicit always remove doc_id == query_id, harms performance on miracl and other datasets

* added the nDCG10 self metric

* set ignore_identical_ids argument

* remove KoMiracl and fix langs

* add linter

* fix tests

* set back default ignore_identical_ids to True

* update retrieval test and set identical_ids to False

* Fix tests for ignore_identical_ids=True

* Update retrieval evaluator and tests

* Keep one set of metrics according to flag ignore_identical_ids

* format

* updated expected values for abstention test

* set ignore_identical_ids to true for required tasks

* Add linting

* add points

* update points

---------

Co-authored-by: Nandan Thakur <nandantgmail.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`306e480`](https://github.com/embeddings-benchmark/mteb/commit/306e4807c50e49536e0ec34d052e49bab998c0b2))

Unknown

* Update tasks table ([`1a62a0b`](https://github.com/embeddings-benchmark/mteb/commit/1a62a0bccc7b055dc6cc4bd6a630793e383419cd))

* Update points table ([`6b68735`](https://github.com/embeddings-benchmark/mteb/commit/6b6873587bb56bc5783571ef29ee05762a45a142))

Fix

* fix: Voyage bclavie/mmarco-japanese-hard-negatives (980)

* no message

* no message

* no message

* update metadata

* change metadata

* add results

* update metadata

* update metadata

* update metadata

* update n_samples and remove line ([`06e0a8b`](https://github.com/embeddings-benchmark/mteb/commit/06e0a8b54885f8886a6ffb57af2f17ed5c1743a7))

Unknown

* Update tasks table ([`4bef147`](https://github.com/embeddings-benchmark/mteb/commit/4bef147c5d9e702414881129476b7fa2e0c68a2c))