Mteb

Documentation

* docs: Update points.md (337) ([`2a3f9e6`](https://github.com/embeddings-benchmark/mteb/commit/2a3f9e6b5db55b7708d2441c78c2dcd47b3ef154))

Feature

* feat: Added new language code standard (326)

* fix: Added initial language code suggestion

* docs: updated task metadata description

* fix: changed folder structure to iso 639-3 codes

* fix: Updated all language tags

* clean: removed accidental results commit

* fix: Add trusting of remote code to remove warning

* fix: Added formatting

* fix: trust remote code the flores dataset

* docs: Added point for language rewrite

* fix: reran linter after merge

* fix: Added corrections from review

* fix: Updated languages for newly added datasets

* docs: added points for new annotations ([`f0daece`](https://github.com/embeddings-benchmark/mteb/commit/f0daece8d8c6491a9d06153763f0d76c2773e251))

Documentation

* docs: add points and affiliation for MartinBernstorff (335)

docs: update points.md ([`2903cb4`](https://github.com/embeddings-benchmark/mteb/commit/2903cb4a738bdae0a5863059c85de97a17c95074))

Fix

* fix: Added medical qa dataset (333)

* Added news classification dataset.

* Fixes on suggestions

* Added new medical qa dataset

* Update model run files and model path

* Added points for dataset.

* Fixes

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`80acc3e`](https://github.com/embeddings-benchmark/mteb/commit/80acc3e39ee6fc27458275b3c2a25e0e13550c44))

Unknown

* Update pull_request_template.md ([`84cffa2`](https://github.com/embeddings-benchmark/mteb/commit/84cffa270923dca711a57b68a739d055efd049a2))

Fix

* fix: Improve logging when the revision is None (329) ([`404587b`](https://github.com/embeddings-benchmark/mteb/commit/404587b81d63d666cb121d0273ce0be1d0e70526))

Fix

* fix: Multiple dataset fixes (328)

* fix: remove time of run (as it does not relate to the model itself). Time of run should be on the dataset results

* fix: fixes the PawsX datasets

* docs: Updated points

* fix: flores clustering

* fix: mulitple dataset fixes

* docs: updated points

* fix: added missing dataset_transform to multitask task

* syle: ran formatter

* fix: correctly fix pawsX ([`84408f7`](https://github.com/embeddings-benchmark/mteb/commit/84408f7bcd422fc59febe19818877299168b08b8))

Documentation

* docs: Added point for SEB (318)

* docs: added points for seb

* docs: added points for seb ([`ca64fc7`](https://github.com/embeddings-benchmark/mteb/commit/ca64fc71ffd1eeecba97bc9a346f28748df5fca7))

* docs: Small fixes in readme.md (317)

Fix typos in readme.md ([`ede12c8`](https://github.com/embeddings-benchmark/mteb/commit/ede12c8705ca42b38ed2dc167acaa4250b816a34))

Fix

* fix: Added English news classification dataset (323)

* Fix typos in readme.md

* Added news classification dataset.

* Added news classification dataset.

* Fixes on suggestions

* Update docs/mmteb/points.md

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`4d21807`](https://github.com/embeddings-benchmark/mteb/commit/4d21807a161aab452ede725144ce4f4c802a8da9))

Unknown

* Fix name ([`d69bf94`](https://github.com/embeddings-benchmark/mteb/commit/d69bf94a20fc584ffe48aafaefaa944df802d497))

* Add law datasets (311)

* add command

* add datasets

* reformat dataset

* Rephrase description

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/__init__.py

* Update scripts/run_mteb_law.py

* Update scripts/run_mteb_law.py

* Update mteb/__init__.py

* Update mteb/tasks/Retrieval/__init__.py

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/tasks/Retrieval/law/LegalQuADRetrieval.py

* Update mteb/tasks/Retrieval/law/LegalQuADRetrieval.py

* Update scripts/run_mteb_law.py

* Update mteb/tasks/Retrieval/law/LegalSummarizationRetrieval.py

* Update mteb/tasks/Retrieval/law/LegalSummarizationRetrieval.py

* Update mteb/tasks/Retrieval/law/LeCaRDv2Retrieval.py

* Update mteb/tasks/Retrieval/law/LeCaRDv2Retrieval.py

* Rename GerDaLIRRetrieval.py to GerDaLIRSmallRetrieval.py

* Update mteb/tasks/Retrieval/__init__.py

* Update GerDaLIRSmallRetrieval.py

Add metadata

* Update GerDaLIRSmallRetrieval.py

Update metadata

* Update AILACasedocsRetrieval.py

Update AILACasedocsRetrieval metadata

* Update AILAStatutesRetrieval.py

Update AILAStatutesRetrieval metadata

* Update LeCaRDv2Retrieval.py

Update LeCaRDv2Retrieval metadata

* Update LegalBenchConsumerContractsQARetrieval.py

Update LegalBenchConsumerContractsQARetrieval metadata

* Update LegalBenchCorporateLobbyingRetrieval.py

Update LegalBenchCorporateLobbyingRetrieval metadata

* Update LegalQuADRetrieval.py

Update LegalQuADRetrieval metadata

* Update LegalSummarizationRetrieval.py

Update LegalSummarizationRetrieval metadata

* Update AILACasedocsRetrieval.py

Update AILACasedocsRetrieval

* Update AILACasedocsRetrieval.py

Update AILACasedocsRetrieval metadata

* Update AILAStatutesRetrieval.py

Update AILAStatutesRetrieval metadata

* Update GerDaLIRSmallRetrieval.py

Update GerDaLIRSmallRetrieval metadata

* Update LeCaRDv2Retrieval.py

Update LeCaRDv2Retrieval metadata

* Update LegalBenchConsumerContractsQARetrieval.py

* Update LegalBenchCorporateLobbyingRetrieval.py

* Update LegalQuADRetrieval.py

* Update LegalSummarizationRetrieval.py

* Update AILACasedocsRetrieval.py

* Update AILAStatutesRetrieval.py

* Update GerDaLIRSmallRetrieval.py

* Update LeCaRDv2Retrieval.py

* move dataset language folder

* update order

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`6e3f419`](https://github.com/embeddings-benchmark/mteb/commit/6e3f41937cf209307aa440560f9eda115b128528))

* Fix PawsX eval splits (316) ([`15285d4`](https://github.com/embeddings-benchmark/mteb/commit/15285d4f4f52737eaad3d105f052eab81da6c603))

Fix

* fix: Minor fixes to metadata (315)

* Update MindSmallReranking.py

* fix: Updated wrong metadata ([`e0eddf9`](https://github.com/embeddings-benchmark/mteb/commit/e0eddf9f0436bda44ffa71134e651d3c70829dc0))

Unknown

* Adding French team contribution points (302)

* Update points.md

* Update docs/mmteb/points.md

* Update points.md

* Update points.md ([`23c9fdd`](https://github.com/embeddings-benchmark/mteb/commit/23c9fdde846aaa297bdc248a79f4e4492082f776))