Mteb

Documentation

* docs: Add missing Author (1188)

add missing author ([`24eb38e`](https://github.com/embeddings-benchmark/mteb/commit/24eb38ee25192c5f1800c6d4f07cf6c45717a63b))

* docs: Adding collaborators user details (1182)

add user details

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`d1e6e5f`](https://github.com/embeddings-benchmark/mteb/commit/d1e6e5f1f487c0562f768f8427ffdfac8a217eef))

Fix

* fix: create_meta (1179)

* refactor: create_meta

* add points

* fix windows ([`a43d1ff`](https://github.com/embeddings-benchmark/mteb/commit/a43d1ff6abf15c6c1dc389e85531af760d654e00))

* fix: Added multilingual and indic benchmark (1174)

* revert pyproject.toml

* format

* format

* added benchmark result tables

* format

* fix: Unsure that tests work with the new update

* Added results fetching to readme

* minor fixes

* Added points for running models
propably a gross misestimation

* Added script for creating contributions and author list (1178)

* Added points for running models
propably a gross misestimation

* docs: Added notebook for creating authorlist, point table and affil table

* format

* Remove aff. upon request from contributor

* format ([`74ec7d2`](https://github.com/embeddings-benchmark/mteb/commit/74ec7d2dfb53b1b77746351d153205fb9bbd9383))

Unknown

* Update tasks table ([`6d6db67`](https://github.com/embeddings-benchmark/mteb/commit/6d6db676a976fb8a434dfbf37d1d2add9fc58f41))

* Update tasks table ([`9ca4ab4`](https://github.com/embeddings-benchmark/mteb/commit/9ca4ab421007efe1fe8b5d363525800680818fdf))

* Update citation ([`d9bc4a1`](https://github.com/embeddings-benchmark/mteb/commit/d9bc4a1e9a68e30fffc38feab06ac281a9fb780f))

Fix

* fix: add points (1180)

* add points

* add 1159

* add openreview

* fix points ([`86fc8a9`](https://github.com/embeddings-benchmark/mteb/commit/86fc8a96ae39f70aeb0d2b3a43062d4112d3a2b8))

Unknown

* Update points table ([`702b31b`](https://github.com/embeddings-benchmark/mteb/commit/702b31b4d1ef523bf5bf509cb514e0faf42d69bf))

Fix

* fix: add citation rumteb (1181) ([`605587a`](https://github.com/embeddings-benchmark/mteb/commit/605587a5e9f7aac42885de1975fa5d40e13c4f52))

Unknown

* format main (1177)

format ([`877db0f`](https://github.com/embeddings-benchmark/mteb/commit/877db0f798cb85abf600a1e30b83d32ad6ebd279))

Fix

* fix: add multilingual mocks and test descriptive_stats (1173)

* add multilingual mocks and test descriptive_stats

* fix task

* lint

* remove comment ([`f941aa0`](https://github.com/embeddings-benchmark/mteb/commit/f941aa0c6b405e4b377c74487271fb927bd4a05b))

* fix: Remove unavailable test split from OCNLI (1175)

fix ocnli ([`b21223a`](https://github.com/embeddings-benchmark/mteb/commit/b21223a39baa1d403fe6f6ebe1ef2fef9e15882f))

Unknown

* Update tasks table ([`5ddff62`](https://github.com/embeddings-benchmark/mteb/commit/5ddff6230d58f92d9a1cb2db7bea16d2236b8476))

Fix

* fix: Added multilingual and indic benchmark

This adds outlines for the multilingual and indic benchmarks as well as a few adjustments to existing benchmarks due to a few discovered bugs in the previous implementation.

It also add utilites for easily creating a table from a list of tasks:


tasks = mteb.get_tasks(tasks=[...])
tasks.to_latex()
tasks.to_dataframe()
([`8c9dada`](https://github.com/embeddings-benchmark/mteb/commit/8c9dadac6b23dc5f05656cc3284109f7d79e03b7))

Unknown

* Update tasks table ([`4699b43`](https://github.com/embeddings-benchmark/mteb/commit/4699b43a232fcdea096be08c899ce7f6479f4914))

Fix

* fix: Added contruction of MTEB(eng, v2) and its lite version (1168)

* Added metadata

* Added EU benchmark given current tasks

* Updated task selection and benchmark

* Added csv

* Added benchmark scores

* Added evaluation time

* format

* fixed baed on corrections

* fix: Added construction of MTEB(eng, v2) and MTEB(eng, v2 lite)

* Added v2 lite comparison with v1

* format

* format

* reformulate to not introduce mtebv2 ([`e861ef2`](https://github.com/embeddings-benchmark/mteb/commit/e861ef24524858800f96012edc887fbd4e67750a))