Mteb

Fix

* fix: Added contruction of MTEB(eng, v2) and its lite version (1168)

* Added metadata

* Added EU benchmark given current tasks

* Updated task selection and benchmark

* Added csv

* Added benchmark scores

* Added evaluation time

* format

* fixed baed on corrections

* fix: Added construction of MTEB(eng, v2) and MTEB(eng, v2 lite)

* Added v2 lite comparison with v1

* format

* format

* reformulate to not introduce mtebv2 ([`e861ef2`](https://github.com/embeddings-benchmark/mteb/commit/e861ef24524858800f96012edc887fbd4e67750a))

Fix

* fix: Added task selection for the EU benchmark (1166)

* Added metadata

* Added EU benchmark given current tasks

* Updated task selection and benchmark

* Added csv

* Added benchmark scores

* Added evaluation time

* format

* fixed baed on corrections

* Added romani

* format ([`0f4f2df`](https://github.com/embeddings-benchmark/mteb/commit/0f4f2dff35381632097ded347ffe5b4b8a767b76))

Unknown

* Update tasks table ([`c220741`](https://github.com/embeddings-benchmark/mteb/commit/c2207410c3e6dd5a161d89808404b1a50a6d1d9b))

Fix

* fix: Add function for metadata create (1167)

* init calculate metadata

* add bitextmetadata

* add classification

* add calculate metrics

* add docs

* fix speed

* fix dummy task

* add typed dict

* update stats

* Apply suggestions from code review

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/abstasks/AbsTaskClassification.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* fix docstrings

* add overall

* update stats

* fix retrieval dict

* change to typeddict

* rename lang to hf_subset

* update task table

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`56382b5`](https://github.com/embeddings-benchmark/mteb/commit/56382b53ef33cd747b3fc65aa0d517480c52ef17))

Fix

* fix: Merge pr 1128 (1169)

* Create arctic_models.py

* Update run_mteb_english_cluster.py

* updates

---------

Co-authored-by: Daniel Campos <daniel.campossnowflake.com> ([`04dbcbb`](https://github.com/embeddings-benchmark/mteb/commit/04dbcbb8535cb81bde1d86ec0e05c0fa865a38d5))

* fix: Update COIR datasets (1159)

* integrate mteb

* fix bug

* update monolingual tasks for coir

* fix bugs

* update

* update

* fix

* remove title

* rm dates

* fix typo

* fix formatting

* edit metadata

* fix

* update new paths

* update revision

* fix

* update

* fix revision

* fix metadata

* add coir codesearchnet

* fix metclass error

* fix metaclass error

* fix hf commit

---------

Co-authored-by: l00856372 <lee.yi.quanhuawei.com> ([`c5bd338`](https://github.com/embeddings-benchmark/mteb/commit/c5bd3381f2efdc985d1538038c50300d733d1923))

Unknown

* Update tasks table ([`ecdc240`](https://github.com/embeddings-benchmark/mteb/commit/ecdc240d7542d18229e05d3e1f60d31a812a0494))

* Format recent additions to the codebase ([`bd2db98`](https://github.com/embeddings-benchmark/mteb/commit/bd2db98cbacc65b2a97a8cf56ab977d19666be44))

Fix

* fix: Ensure that summarization only calculates the metric across the statistic. (1157)

* fix: Ensure that summarization only calculates the metric across the statistic.

Fixes 1156

* Added versioning to datasets ([`e57efad`](https://github.com/embeddings-benchmark/mteb/commit/e57efad4655460506111cecbfba9144d813424d4))

Unknown

* Update tasks table ([`b47a81e`](https://github.com/embeddings-benchmark/mteb/commit/b47a81ed6c4b330988854ca63d68783f282acbb1))

Documentation

* docs: format notebooks and upgrade ruff (1164) ([`4e98381`](https://github.com/embeddings-benchmark/mteb/commit/4e98381993fa1c1e55ceeb4e1ba6f5d99d4f0192))

Fix

* fix: load_data in MintakaRetrieval (1155)

fix: add trust remote code ([`1a1ea2e`](https://github.com/embeddings-benchmark/mteb/commit/1a1ea2eaf9eded2435a613ac12203bbb288d4838))

Unknown

* Fix: test wrappers and export all tasks results in tests (1116)

* test wrappers and export all tasks results

* lint

* change to monkeypatch

* lint

* add Mxbai

* Update tests/test_benchmark/mock_models.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* remove create meta test

* remove gritlm models

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`7f3ad0e`](https://github.com/embeddings-benchmark/mteb/commit/7f3ad0e8c4929a518f0815d51193ea7f7b1acb4a))

* Update ruMTEB tasks list (1163)

* update Russian benchmark

* add detailed instructions

* add language filter

* fix lint ([`f619201`](https://github.com/embeddings-benchmark/mteb/commit/f619201a9ab91d453d7f500a0db6f8f3789a5840))