Mteb

Documentation

* docs: Updated examples in docs (adding a dataset) (353)

* docs: Updated examples in documentation

* docs: Updated taskmetadata to better describe edge cases ([`9b63f50`](https://github.com/embeddings-benchmark/mteb/commit/9b63f50694196666b75c5ccc0bd9ce8dc3206fa7))

* docs: Updated examples in documentation (351) ([`6832cf0`](https://github.com/embeddings-benchmark/mteb/commit/6832cf02b34d7959986dd36d18bf496a5b699f74))

Fix

* fix: add Japanese Question Answering Dataset (JaQuAD) dataset (352)

* add JaQuAD dataset

* fix

* add dataset stats

* fix dataset stats ([`ae6adf4`](https://github.com/embeddings-benchmark/mteb/commit/ae6adf447d50953f8f2c99e06781e75b3a06514e))

Documentation

* docs: Added points for previous submissions (344)

* docs: Added missing points for 214

Added 6x2 points for guenthermi for datasets and 1 point to  Muennighoff for review

I have not accounted for bonus points as I am not sure was what available at the time.

* docs: added point for 197

Added 2 points for rasdani and 2 bonus points for the first german retrieval (I believe). Added one point for each of the reviewers

* docs: added points for 116

This includes 6 points for 3 datasets to slvnwhrl +2 for first german clustering task also added points for reviews

* Added points for 134 cmteb

This includes 29 datasets (38 points) and 6x2 bonus points (12 points) for the 6 taskXlanguage which was not previously included.

All the points are attributed to staoxiao, though we can split them if needed.

We also added points for review.

* docs: Added points for 137 polish

This includes points for 12 datasets (24) across 4 tasks (8). These points are given to rafalposwiata and then one point for review

* docs: Added points for 27 (spanish)

These include 9 datasets (18 points) across 4 news tasks (8) for spanish.

Points are given to violenil as the contributor, and one points for reviewers. Points can be split up if needed.

* docs: Added points for 224

Added points 2 points for the dataset. I could imagine that I might have missed some bonus points as well. Also added one point for review.

* docs: Added points for 210 (korean)

This include 3 datasets (6 points) across 1 new task (+2 bonus) for korean. Also added 1 points for reviewers.

* Add contributor

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`9dbf500`](https://github.com/embeddings-benchmark/mteb/commit/9dbf500c7bb3d427345549f7698e15482cf024c7))

Fix

* fix: Added Hindi discourse dataset (346)

* Added news classification dataset.

* Fixes on suggestions

* Added new medical qa dataset

* Update model run files and model path

* Added points for dataset.

* Fixes

* Added hindi discourse dataset

* Added points

* Added avg char length

* Fixes

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`a55ae5f`](https://github.com/embeddings-benchmark/mteb/commit/a55ae5f5b9c722d861faf5ff8c33c5dd4cb4f598))

Unknown

* Update readme.md ([`2dec4e9`](https://github.com/embeddings-benchmark/mteb/commit/2dec4e9da4e1cc63554d12de19a41e3bbea6a496))

* Removing bitext mining tasks from fr evaluation script (341)

fix: removing bitextmining tasks from fr script ([`86ad02d`](https://github.com/embeddings-benchmark/mteb/commit/86ad02d2d991b5786c9cad7922713f2e36c4831d))

Documentation

* docs: Update mmteb (338)

docs: update mmteb ([`bee4244`](https://github.com/embeddings-benchmark/mteb/commit/bee424410a62b4602db70062a869302ae6faf068))

Fix

* fix: missing json and updated tests to not run in editable mode (340)

* fix: Added json files to pyproject.toml

* ci: avoid using -e when installing for tests ([`17c809d`](https://github.com/embeddings-benchmark/mteb/commit/17c809d219f95b8570ab044a60b7c56d0ac5b92c))

Documentation

* docs: Update points.md (337) ([`2a3f9e6`](https://github.com/embeddings-benchmark/mteb/commit/2a3f9e6b5db55b7708d2441c78c2dcd47b3ef154))

Feature

* feat: Added new language code standard (326)

* fix: Added initial language code suggestion

* docs: updated task metadata description

* fix: changed folder structure to iso 639-3 codes

* fix: Updated all language tags

* clean: removed accidental results commit

* fix: Add trusting of remote code to remove warning

* fix: Added formatting

* fix: trust remote code the flores dataset

* docs: Added point for language rewrite

* fix: reran linter after merge

* fix: Added corrections from review

* fix: Updated languages for newly added datasets

* docs: added points for new annotations ([`f0daece`](https://github.com/embeddings-benchmark/mteb/commit/f0daece8d8c6491a9d06153763f0d76c2773e251))

Documentation

* docs: add points and affiliation for MartinBernstorff (335)

docs: update points.md ([`2903cb4`](https://github.com/embeddings-benchmark/mteb/commit/2903cb4a738bdae0a5863059c85de97a17c95074))

Fix

* fix: Added medical qa dataset (333)

* Added news classification dataset.

* Fixes on suggestions

* Added new medical qa dataset

* Update model run files and model path

* Added points for dataset.

* Fixes

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`80acc3e`](https://github.com/embeddings-benchmark/mteb/commit/80acc3e39ee6fc27458275b3c2a25e0e13550c44))

Unknown

* Update pull_request_template.md ([`84cffa2`](https://github.com/embeddings-benchmark/mteb/commit/84cffa270923dca711a57b68a739d055efd049a2))

Fix

* fix: Improve logging when the revision is None (329) ([`404587b`](https://github.com/embeddings-benchmark/mteb/commit/404587b81d63d666cb121d0273ce0be1d0e70526))