Mteb

Fix

* fix: Add openai and voyage models (887)

* Add openai and voyage models

* Add rate limit for voyage model

* Add rate and token limit for voyage ([`ad9b3ce`](https://github.com/embeddings-benchmark/mteb/commit/ad9b3ce2bfd4ac90dab74d397d740afbe8f142a5))

Unknown

* Update points table ([`052c9dd`](https://github.com/embeddings-benchmark/mteb/commit/052c9dd646f6ea3d6154db516310a9f3e1c8482d))

Documentation

* docs: Update points.md (890) ([`4318c82`](https://github.com/embeddings-benchmark/mteb/commit/4318c8223dcd1f82038eb63d2cbe4970af1d539b))

Fix

* fix: abstention metric for small datasets (893)

* fix abstention bug

* make lint ([`9d28296`](https://github.com/embeddings-benchmark/mteb/commit/9d2829671c5e2833bcc65c37f65c2ed87c3ae825))

Unknown

* Update tasks table ([`bab7503`](https://github.com/embeddings-benchmark/mteb/commit/bab7503c20f8c46172b263cb4e5fb7d77484b5b3))

* Update points table ([`c61ab09`](https://github.com/embeddings-benchmark/mteb/commit/c61ab09aa084dc6dbf26f71027a4fac1ddce1abb))

* Added multilabel stratification to AbsTaskMultilabelClassification (760)

merge conflicts fixed for stratification ([`d7dc9a8`](https://github.com/embeddings-benchmark/mteb/commit/d7dc9a80db287c28899d0aa481f36c9c7c9ca78a))

Fix

* fix: Add GritLM (880)

* Add GritLM

* Remove unused imports

* Use embedding mode to save memory

* Format

* Format

* Add langs

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Add langs

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Change loader

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`0c99a4e`](https://github.com/embeddings-benchmark/mteb/commit/0c99a4ebcc4a6f3a47fe5e59161c832ddbea9294))

Documentation

* docs: Added source for CmedqaRetrieval (886)

docs: update CmedqaRetrieval description to specify source ([`3e910ff`](https://github.com/embeddings-benchmark/mteb/commit/3e910ff76b5cc4713682d2cef2dd860e38de513a))

Fix

* fix: Add error reporting for Retrieval (873)

* add error reporting.
* no message
* Update mteb/abstasks/AbsTaskRetrieval.py
Co-authored-by: Isaac Chung <chungisaac1217gmail.com>
* add kwarg args
* change to metadata.name
* fix format
* Update mteb/abstasks/AbsTaskRetrieval.py
Co-authored-by: Isaac Chung <chungisaac1217gmail.com>
* change to explicit args
* remove cmdline changes
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`5397bd2`](https://github.com/embeddings-benchmark/mteb/commit/5397bd2153700ff026697038d6174fe67b6033d8))

Fix

* fix: Updated CLI for MTEB (882)

* Updated CLI for MTEB

It now includes three main commands one for running, one for getting an overview and one for creating the metadata for hf.

I also
- added lower bound on dependencies as it caused a few issues.
- deleted some results with a model revision attached (also created a fix to make sure that doesn&39;t happen as much going forward)
- Added a test for the cli
- Added a quite extensive docstring to the CLI
- made relevant changed to the documentation

* ensure tests pass

* minor changes to PR template

* Minor changes to PR template

* remove tmp file

* fixed failing test and updated it to avoid future false positives

* fix deprecation warning for logger.warn

* don&39;t clear path before running tests as it disturbs other tests when run in parallel ([`c6f618b`](https://github.com/embeddings-benchmark/mteb/commit/c6f618b0ab5b265acf8ac736db1ddca8d73222c5))

Documentation

* docs: minor fix for point validation to avoid error when people split up points ([`7d0d631`](https://github.com/embeddings-benchmark/mteb/commit/7d0d6319f67251b65b37ec835adea605aa05c893))

Fix

* fix: Add CEDR, SensitiveTopics for multilabel and RuBQ for reranking (881)

* add russian reranking and multilabel tasks

* fix import order

* add results for baselines

* add points

* add points for review ([`9128df4`](https://github.com/embeddings-benchmark/mteb/commit/9128df46f4d9deb06ad1878b321942ac281cfc7d))

Unknown

* Update tasks table ([`7d3ce53`](https://github.com/embeddings-benchmark/mteb/commit/7d3ce53d017a11b9427ed04a7af7828fee5cc7b7))

* Update points table ([`ef52f95`](https://github.com/embeddings-benchmark/mteb/commit/ef52f95e13ed00caef0b77a5c6d8e39c18293793))

* Merge branch &39;main&39; of https://github.com/embeddings-benchmark/mteb ([`7c7ee2b`](https://github.com/embeddings-benchmark/mteb/commit/7c7ee2bd27c01930d05a63e55891882b5d70a761))

* Updated CLI for MTEB

It now includes three main commands one for running, one for getting an overview and one for creating the metadata for hf.

I also
- added lower bound on dependencies as it caused a few issues.
- deleted some results with a model revision attached (also created a fix to make sure that doesn&39;t happen as much going forward)
- Added a test for the cli
- Added a quite extensive docstring to the CLI
- made relevant changed to the documentation ([`29b1c34`](https://github.com/embeddings-benchmark/mteb/commit/29b1c347270594d4fe4ad6b928b245a92c885077))