Mteb

Documentation

* docs: Add points for 911 (913)

Add poinhts ([`5deeb3c`](https://github.com/embeddings-benchmark/mteb/commit/5deeb3c6351fbedde24dc77d8981e32562d9b516))

Fix

* fix: Update annotations for English STS tasks (908)

* Update STS16STS.py

* Update STS15STS.py

* Update STS14STS.py

* Update STS13STS.py

* add points for 902&908 prs

* Update STS16STS.py

* Update STS14STS.py

* Update STS14STS.py

* Update STS16STS.py

---------

Co-authored-by: Tikhonova Maria <m_tikhonova94mail.ru> ([`f1dd8bb`](https://github.com/embeddings-benchmark/mteb/commit/f1dd8bb60fe730d34fcd7bb909834ad1d9daba80))

Unknown

* Update tasks table ([`844e743`](https://github.com/embeddings-benchmark/mteb/commit/844e7432de16d4ffea07bd4312f18da1e7bc6fdc))

* Update points table ([`cffd94c`](https://github.com/embeddings-benchmark/mteb/commit/cffd94c1699fd9a4f954950eb7adcebee169da45))

Documentation

* docs: Update annotations for multilingual STS tasks (902)

* Update STS12STS.py

* Update STSBenchmarkMultilingualSTS.py

* Update STS22CrosslingualSTS.py

* Update STS17CrosslingualSTS.py

* Update STS22CrosslingualSTS.py

* Update STSBenchmarkMultilingualSTS.py

* Update STS17CrosslingualSTS.py

* Update STS12STS.py

* Update STS17CrosslingualSTS.py

* Update STSBenchmarkMultilingualSTS.py

* Update STS22CrosslingualSTS.py

---------

Co-authored-by: Tikhonova Maria <m_tikhonova94mail.ru> ([`4383fd3`](https://github.com/embeddings-benchmark/mteb/commit/4383fd3a65c16df9598581f32643408e33273cb0))

Fix

* fix: Incorrect handling of qrel_revision fix: 909 (911)

* fix: 909

* fix: 909

* add: points

* clean ([`63cd4b7`](https://github.com/embeddings-benchmark/mteb/commit/63cd4b7f99e9371a90e26014a328231b1f3db810))

Unknown

* Update tasks table ([`30433a9`](https://github.com/embeddings-benchmark/mteb/commit/30433a9a7d8ef6b2b47a95cf2ff9b002088b8a03))

* Update points table ([`d771437`](https://github.com/embeddings-benchmark/mteb/commit/d77143791408269ea69fd6455f4dd5a6782d1805))

* (1) Add WebLINX Candidate Elements Reranking Task; (2) move `convert_conv_history_to_query` from `mteb.evaluation.evaluators.RetrievalEvaluator` to `mteb.evaluation.evaluators.utils` (820)

* Initial file (WIP)

* Update dates, and indicate dotos

* Update mteb/tasks/Reranking/eng/WebLINXCandidatesReranking.py

* Move `convert_conv_history_to_query` from RetrievalEvaluator to utils

* Add WebLINXCandidatesReranking to mteb.tasks.Reranking

* Lint RetrievalEvaluator&39;s imports

* lint mteb.evaluation.evaluator.utils

* Update dataset path, name and revision, n_samples and avg_character_lenght

* Update revision, add load_data method

* Fix typo

* Change main score to mrr, since recall10 is not supported

* Add average results

* Add points

* Run `make lint` ([`e34ddaa`](https://github.com/embeddings-benchmark/mteb/commit/e34ddaac76777e4f3a360a30b5ee2d111c5a9f61))

* Update tasks table ([`b16d7d5`](https://github.com/embeddings-benchmark/mteb/commit/b16d7d5620b987992e16ee663e5d82ee007acd8e))

Documentation

* docs: Add points for paper writing (901)

* add points for paper writing

* add PR number

* correct typo ([`fbbc44b`](https://github.com/embeddings-benchmark/mteb/commit/fbbc44b51702930d3dafbc6f7529233c5de7a138))

Fix

* fix: Backfilled bibtex citations data (900)

* Added IndicNLP News Classificaiton

* Added IndicNLP News Classificaiton

* Added results

* Updated dataset version

* Small fixes

* Small fix

* Small fix

* Updated results

* Fix linting issues

* Added points

* Resolve conflict

* Update 610.jsonl

* Backfilled missing bibtex citations.

* Backfilled missing bibtex citations.

* Remove non-present files

---------

Co-authored-by: Imene Kerboua <33312980+imenelydiakerusers.noreply.github.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`77d0e06`](https://github.com/embeddings-benchmark/mteb/commit/77d0e06e88e7645d14c278b25a9bbb6c97b8fed6))

Unknown

* Update points table ([`a7ce58f`](https://github.com/embeddings-benchmark/mteb/commit/a7ce58f81728e7adaba940d30f41fe124e4ad64d))

* Update tasks table ([`97eb8b3`](https://github.com/embeddings-benchmark/mteb/commit/97eb8b342f42a372dc74449c383ecc20c3c9f7a3))

Fix

* fix: Add openai and voyage models (887)

* Add openai and voyage models

* Add rate limit for voyage model

* Add rate and token limit for voyage ([`ad9b3ce`](https://github.com/embeddings-benchmark/mteb/commit/ad9b3ce2bfd4ac90dab74d397d740afbe8f142a5))

Unknown

* Update points table ([`052c9dd`](https://github.com/embeddings-benchmark/mteb/commit/052c9dd646f6ea3d6154db516310a9f3e1c8482d))

Documentation

* docs: Update points.md (890) ([`4318c82`](https://github.com/embeddings-benchmark/mteb/commit/4318c8223dcd1f82038eb63d2cbe4970af1d539b))

Fix

* fix: abstention metric for small datasets (893)

* fix abstention bug

* make lint ([`9d28296`](https://github.com/embeddings-benchmark/mteb/commit/9d2829671c5e2833bcc65c37f65c2ed87c3ae825))

Unknown

* Update tasks table ([`bab7503`](https://github.com/embeddings-benchmark/mteb/commit/bab7503c20f8c46172b263cb4e5fb7d77484b5b3))

* Update points table ([`c61ab09`](https://github.com/embeddings-benchmark/mteb/commit/c61ab09aa084dc6dbf26f71027a4fac1ddce1abb))

* Added multilabel stratification to AbsTaskMultilabelClassification (760)

merge conflicts fixed for stratification ([`d7dc9a8`](https://github.com/embeddings-benchmark/mteb/commit/d7dc9a80db287c28899d0aa481f36c9c7c9ca78a))

Fix

* fix: Add GritLM (880)

* Add GritLM

* Remove unused imports

* Use embedding mode to save memory

* Format

* Format

* Add langs

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Add langs

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Change loader

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`0c99a4e`](https://github.com/embeddings-benchmark/mteb/commit/0c99a4ebcc4a6f3a47fe5e59161c832ddbea9294))