Mteb

Ci

* ci: remove positional argument (1191)

remove positional argument ([`b75cd29`](https://github.com/embeddings-benchmark/mteb/commit/b75cd299f724ef78a2b5951f140b509169f1c784))

Documentation

* docs: Add xhluca to contributor list (1196)

Add Xing Han Lu to contributor list

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`660bd1c`](https://github.com/embeddings-benchmark/mteb/commit/660bd1cc858707cbb037d801c1c64729c7d17474))

* docs: Add affiliation of mrshu (1199)

* Add affiliation details of mrshu to `docs/mteb/points.md`

Signed-off-by: mr.Shu <mrshu.io> ([`75cabc9`](https://github.com/embeddings-benchmark/mteb/commit/75cabc9344c63ccf674689db7970bff17634e3d2))

* docs: Adding contributor details (1195)

Adding contributor details

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`acd631a`](https://github.com/embeddings-benchmark/mteb/commit/acd631a972495fe0b410644fdac1d3eb84ccdb31))

* docs: Added points for ideation and coordination (1194)

* fix: Added points for ideation and coordination

We have added 50 points for primary coordinators, 20 points for secondary coordinators and 20 points for ideation.

I additionally checked for users which have more than 10 point, but where we do not have their author information.

Will just ping you guys here to ensure that you get a chance to add the authorship information (akshita-sukhlecha, loicmagne, mrshu, crystina-z, thakur-nandan, xhluca)

If anyone notice any other authors which haven&39;t yet been credited please let me know!

* added secondary contributor ([`8b0834d`](https://github.com/embeddings-benchmark/mteb/commit/8b0834dc1c2480052faec786c9bcd3067e0e2e0a))

* docs: authorship-info for crystina-z (1198) ([`08c1efe`](https://github.com/embeddings-benchmark/mteb/commit/08c1efe57387c429ddbec3d36bfa717f99879b8b))

* docs: Adding contributor details (1184)

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`0fc93dc`](https://github.com/embeddings-benchmark/mteb/commit/0fc93dca1170866d2236bfee664b82e05f230b2d))

* docs: add reranker / cross encoder to README advanced usage (1186)

* add reranker / cross encoder to README advanced usage

* use preferred way for task selection

* make script runnable ([`aa5479d`](https://github.com/embeddings-benchmark/mteb/commit/aa5479da71a40b545dd339d345101d3a02e688c3))

* docs: Update contributors table (1189)

Add conributor information ([`929733b`](https://github.com/embeddings-benchmark/mteb/commit/929733b4ea172a5d9deeb85ef59af71e5492b863))

Fix

* fix: Ensure STS pearson and spearman does not use the p-value only the correlation (1207)

Fixes 1206 ([`5aa401d`](https://github.com/embeddings-benchmark/mteb/commit/5aa401dcc7ec5bdf6ccbc9cfe1207267a08c4523))

* fix: OpenAI BadRequestError by limiting input dimensions to 2048 elem… (1203)

* fix: OpenAI BadRequestError by limiting input dimensions to 2048 elements (1201)

Fix OpenAI BadRequestError by limiting input dimensions to 2048 elements

- Ensure the &39;sentences&39; list passed to OpenAI API does not exceed 2048 elements
- Reference: OpenAI&39;s Embedding API documentation on input limits

Co-authored-by: Ali Shiraee <ShiraeAbasfad.basf.net>

* fix ruff formatting

* Added minor test fixes to ensure reproducility across systems

* Ensure that tmp.json is not created within repo when running tests

* format

* fixes path issues

* Rerun CI

---------

Co-authored-by: HSILA <a.shiraeegmail.com>
Co-authored-by: Ali Shiraee <ShiraeAbasfad.basf.net> ([`ba562ce`](https://github.com/embeddings-benchmark/mteb/commit/ba562cef8a123f1b760d70b66ad6e1d959c7c3bc))

Unknown

* Update points table ([`16b2220`](https://github.com/embeddings-benchmark/mteb/commit/16b222019c595aea7cdbbb04b506736851c6316b))

* Update points table ([`9733d06`](https://github.com/embeddings-benchmark/mteb/commit/9733d06764f71cddf3755993b49f6f1006609903))

* Update points table ([`a574c76`](https://github.com/embeddings-benchmark/mteb/commit/a574c76c53abebc65a1e3148afdd83ff6cd95d8b))

* Update points table ([`6b50759`](https://github.com/embeddings-benchmark/mteb/commit/6b50759ae6cb45e4b8a622ef386fbece91698e24))

* Update points table ([`b8fb4d3`](https://github.com/embeddings-benchmark/mteb/commit/b8fb4d31fc9b504bbb8cc489fabcaaddc4558f22))

* Update points table ([`1024b24`](https://github.com/embeddings-benchmark/mteb/commit/1024b24cffb46f1a0d98061aa6899a6cb285018f))

* Update points table ([`4c1b6b5`](https://github.com/embeddings-benchmark/mteb/commit/4c1b6b5ffb5ba149e668e2172df2d55b8355966c))

Fix

* fix: Add save prediction cli (1187)

* add save predictions cli option

* add how to save retrieval task predictions to README

* simplify example script

* add cli test

* Update README.md

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`826cdf5`](https://github.com/embeddings-benchmark/mteb/commit/826cdf513d233d8a71019bf75fef7f3f76991b5e))

Fix

* fix: Remove test set form eval sets as test labels are unknown (1190) ([`d375ff7`](https://github.com/embeddings-benchmark/mteb/commit/d375ff7b252309492c7f30f0706f4a4d9388d95c))

Documentation

* docs: Add missing Author (1188)

add missing author ([`24eb38e`](https://github.com/embeddings-benchmark/mteb/commit/24eb38ee25192c5f1800c6d4f07cf6c45717a63b))

* docs: Adding collaborators user details (1182)

add user details

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`d1e6e5f`](https://github.com/embeddings-benchmark/mteb/commit/d1e6e5f1f487c0562f768f8427ffdfac8a217eef))

Fix

* fix: create_meta (1179)

* refactor: create_meta

* add points

* fix windows ([`a43d1ff`](https://github.com/embeddings-benchmark/mteb/commit/a43d1ff6abf15c6c1dc389e85531af760d654e00))

* fix: Added multilingual and indic benchmark (1174)

* revert pyproject.toml

* format

* format

* added benchmark result tables

* format

* fix: Unsure that tests work with the new update

* Added results fetching to readme

* minor fixes

* Added points for running models
propably a gross misestimation

* Added script for creating contributions and author list (1178)

* Added points for running models
propably a gross misestimation

* docs: Added notebook for creating authorlist, point table and affil table

* format

* Remove aff. upon request from contributor

* format ([`74ec7d2`](https://github.com/embeddings-benchmark/mteb/commit/74ec7d2dfb53b1b77746351d153205fb9bbd9383))

Unknown

* Update tasks table ([`6d6db67`](https://github.com/embeddings-benchmark/mteb/commit/6d6db676a976fb8a434dfbf37d1d2add9fc58f41))

* Update tasks table ([`9ca4ab4`](https://github.com/embeddings-benchmark/mteb/commit/9ca4ab421007efe1fe8b5d363525800680818fdf))

* Update citation ([`d9bc4a1`](https://github.com/embeddings-benchmark/mteb/commit/d9bc4a1e9a68e30fffc38feab06ac281a9fb780f))

Fix

* fix: add points (1180)

* add points

* add 1159

* add openreview

* fix points ([`86fc8a9`](https://github.com/embeddings-benchmark/mteb/commit/86fc8a96ae39f70aeb0d2b3a43062d4112d3a2b8))

Unknown

* Update points table ([`702b31b`](https://github.com/embeddings-benchmark/mteb/commit/702b31b4d1ef523bf5bf509cb514e0faf42d69bf))

Fix

* fix: add citation rumteb (1181) ([`605587a`](https://github.com/embeddings-benchmark/mteb/commit/605587a5e9f7aac42885de1975fa5d40e13c4f52))

Unknown

* format main (1177)

format ([`877db0f`](https://github.com/embeddings-benchmark/mteb/commit/877db0f798cb85abf600a1e30b83d32ad6ebd279))