Mteb

Fix

* fix: Multiple dataset fixes (328)

* fix: remove time of run (as it does not relate to the model itself). Time of run should be on the dataset results

* fix: fixes the PawsX datasets

* docs: Updated points

* fix: flores clustering

* fix: mulitple dataset fixes

* docs: updated points

* fix: added missing dataset_transform to multitask task

* syle: ran formatter

* fix: correctly fix pawsX ([`84408f7`](https://github.com/embeddings-benchmark/mteb/commit/84408f7bcd422fc59febe19818877299168b08b8))

Documentation

* docs: Added point for SEB (318)

* docs: added points for seb

* docs: added points for seb ([`ca64fc7`](https://github.com/embeddings-benchmark/mteb/commit/ca64fc71ffd1eeecba97bc9a346f28748df5fca7))

* docs: Small fixes in readme.md (317)

Fix typos in readme.md ([`ede12c8`](https://github.com/embeddings-benchmark/mteb/commit/ede12c8705ca42b38ed2dc167acaa4250b816a34))

Fix

* fix: Added English news classification dataset (323)

* Fix typos in readme.md

* Added news classification dataset.

* Added news classification dataset.

* Fixes on suggestions

* Update docs/mmteb/points.md

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`4d21807`](https://github.com/embeddings-benchmark/mteb/commit/4d21807a161aab452ede725144ce4f4c802a8da9))

Unknown

* Fix name ([`d69bf94`](https://github.com/embeddings-benchmark/mteb/commit/d69bf94a20fc584ffe48aafaefaa944df802d497))

* Add law datasets (311)

* add command

* add datasets

* reformat dataset

* Rephrase description

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/__init__.py

* Update scripts/run_mteb_law.py

* Update scripts/run_mteb_law.py

* Update mteb/__init__.py

* Update mteb/tasks/Retrieval/__init__.py

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/tasks/Retrieval/law/GerDaLIRRetrieval.py

* Update mteb/tasks/Retrieval/law/LegalQuADRetrieval.py

* Update mteb/tasks/Retrieval/law/LegalQuADRetrieval.py

* Update scripts/run_mteb_law.py

* Update mteb/tasks/Retrieval/law/LegalSummarizationRetrieval.py

* Update mteb/tasks/Retrieval/law/LegalSummarizationRetrieval.py

* Update mteb/tasks/Retrieval/law/LeCaRDv2Retrieval.py

* Update mteb/tasks/Retrieval/law/LeCaRDv2Retrieval.py

* Rename GerDaLIRRetrieval.py to GerDaLIRSmallRetrieval.py

* Update mteb/tasks/Retrieval/__init__.py

* Update GerDaLIRSmallRetrieval.py

Add metadata

* Update GerDaLIRSmallRetrieval.py

Update metadata

* Update AILACasedocsRetrieval.py

Update AILACasedocsRetrieval metadata

* Update AILAStatutesRetrieval.py

Update AILAStatutesRetrieval metadata

* Update LeCaRDv2Retrieval.py

Update LeCaRDv2Retrieval metadata

* Update LegalBenchConsumerContractsQARetrieval.py

Update LegalBenchConsumerContractsQARetrieval metadata

* Update LegalBenchCorporateLobbyingRetrieval.py

Update LegalBenchCorporateLobbyingRetrieval metadata

* Update LegalQuADRetrieval.py

Update LegalQuADRetrieval metadata

* Update LegalSummarizationRetrieval.py

Update LegalSummarizationRetrieval metadata

* Update AILACasedocsRetrieval.py

Update AILACasedocsRetrieval

* Update AILACasedocsRetrieval.py

Update AILACasedocsRetrieval metadata

* Update AILAStatutesRetrieval.py

Update AILAStatutesRetrieval metadata

* Update GerDaLIRSmallRetrieval.py

Update GerDaLIRSmallRetrieval metadata

* Update LeCaRDv2Retrieval.py

Update LeCaRDv2Retrieval metadata

* Update LegalBenchConsumerContractsQARetrieval.py

* Update LegalBenchCorporateLobbyingRetrieval.py

* Update LegalQuADRetrieval.py

* Update LegalSummarizationRetrieval.py

* Update AILACasedocsRetrieval.py

* Update AILAStatutesRetrieval.py

* Update GerDaLIRSmallRetrieval.py

* Update LeCaRDv2Retrieval.py

* move dataset language folder

* update order

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`6e3f419`](https://github.com/embeddings-benchmark/mteb/commit/6e3f41937cf209307aa440560f9eda115b128528))

* Fix PawsX eval splits (316) ([`15285d4`](https://github.com/embeddings-benchmark/mteb/commit/15285d4f4f52737eaad3d105f052eab81da6c603))

Fix

* fix: Minor fixes to metadata (315)

* Update MindSmallReranking.py

* fix: Updated wrong metadata ([`e0eddf9`](https://github.com/embeddings-benchmark/mteb/commit/e0eddf9f0436bda44ffa71134e651d3c70829dc0))

Unknown

* Adding French team contribution points (302)

* Update points.md

* Update docs/mmteb/points.md

* Update points.md

* Update points.md ([`23c9fdd`](https://github.com/embeddings-benchmark/mteb/commit/23c9fdde846aaa297bdc248a79f4e4492082f776))

Fix

* fix: Added tests for checking datasets (307)

* fix: Fixed hf_hub_name for WikiCitiesClustering

* Added points for this PR and a 3 other minor dataset fixes

* feat: Added tests which validated that datasets are available

* fix: Updated hf references and revisions to multiple datasets

* Added points for submission

* fix: Added suggestions from the review

* Apply suggestions from code review

Co-authored-by: Imene Kerboua <33312980+imenelydiakerusers.noreply.github.com>

* fix: sped up async test for whether datasets exist

* fix: Updated revisions

* fix: reuploaded scandeval datasets

* fix: Applied formatter

---------

Co-authored-by: Imene Kerboua <33312980+imenelydiakerusers.noreply.github.com> ([`8d804f4`](https://github.com/embeddings-benchmark/mteb/commit/8d804f4956ea66b68b25c14ab05bc5ad2e102ff7))

Feature

* feat: Allow extending the load_dataset parameters in custom tasks inheriting AbsTask (299)

* Allow extending the load_dataset parameters

* format

* Fix test

* remove duplicated logic from AbsTask, now handled in the metadata

* add tests

* remove comments, moved to PR

* format

* extend metadata dict from super class

* Remove additional load_data

* test: adding very high level test

* Remove hf_hub_name and add test

* Fix revision in output file

---------

Co-authored-by: gbmarc1 <marcantoine.belangershopify.com> ([`953780d`](https://github.com/embeddings-benchmark/mteb/commit/953780dd680309cbae78f6543c005965ad9caf01))

Fix

* fix: hf_hub_name for WikiCitiesClustering (305)

* fix: Fixed hf_hub_name for WikiCitiesClustering

* Added points for this PR and a 3 other minor dataset fixes ([`b447235`](https://github.com/embeddings-benchmark/mteb/commit/b447235a18d2fb7261c6cb6cbb214e0bbd15452c))