Mteb

Fix

* fix: update ru models annotation (2181) ([`3325f7e`](https://github.com/embeddings-benchmark/mteb/commit/3325f7e661089df9e3ff6ca38786e855054f8df7))

Fix

* fix: Added training data for sentence-croissant (2189) ([`0901cf6`](https://github.com/embeddings-benchmark/mteb/commit/0901cf68b0a7841f350a05a5c87345c557604fd8))

Fix

* fix: Added training data annotation for MMLW models (2188)

* Added training data annotation for MMLW models

* Added GIST annotations Kenneth missed

* Added Stella en 400m training data&39; ([`0307102`](https://github.com/embeddings-benchmark/mteb/commit/03071024e4e20845bf73809ad55711f71ef953a9))

* fix: Update MTEB(Scandinavian) to use new DanFEVER (2180)

This also resolves the missing data in the leaderboard.

Fixes 2172 ([`7daf893`](https://github.com/embeddings-benchmark/mteb/commit/7daf89395b4ee04d5b2adda582e3bd82df0a0d47))

* fix: Added training data annotations to MXBAI (2185) ([`1b23d4e`](https://github.com/embeddings-benchmark/mteb/commit/1b23d4e73191c54f9caac91ff41cd64835cc2a37))

Unknown

* Added training data annotation for e5-base-4k (2186) ([`43d15f1`](https://github.com/embeddings-benchmark/mteb/commit/43d15f1bef747389109648dc5eac5c8f36c7facc))

Fix

* fix: Add more training data annotations (2178)

* redo to voyage to only training data

* Add training data annotation for Kalm embeddings 2168

* Add correct training data annotations to Stella 2164

* removed fiqa PL as it does not exist

* remove ArxivClusteringS2S.v2 as it does not exist

* Add training data annotation for GIST embedding 2166

* fix max tokens for kalm models 2162

* remove eli 5

* fix: add training data for Bilingual Embeddings

fixes 2167 ([`1959c73`](https://github.com/embeddings-benchmark/mteb/commit/1959c73bb1ce2791e1d171e4c40077079817efc3))

* fix: update training datasets and revision for jina models (2179)

* feat: update training datasets and revision for jina models

* feat: update training datasets and revision for jina models ([`62b33f2`](https://github.com/embeddings-benchmark/mteb/commit/62b33f26c5550e2b9e9fcd78fe78c4fcb2f698aa))

Feature

* feat: Add MIEB and MIEB-lite as benchmarks (2035)

* add mieb and mieb-lite to benchmarks

* add CompositionalityEvaluation and DocumentUnderstanding types

* add VisionCentric type

* add missing comma

* split STS17MultilingualVisualSTS and STSBenchmarkMultilingualSTS to eng and non-eng

* use aggregate task instead so we can name the subsets

* shorten names

* fix import

* alternative strategy to avoid using get_task

* follow other aggregate tasks and skip metadata test

* run LB without errors when selecting MIEB(-lite)

* add back the capability as taks type

* typo

* extend description

* split into mieb(eng) and mieb(multilingual)

* remove unneeded files

* remove aggtask additions for test

* edit descriptions based on screenshots

* shorten

* rename to Compositionality and include ImageCoDeT2IMultiChoice

* re-tag missing VisionCentric tasks

* re-tag rparis and roxford as retrieval and include fixes

* re-tag voc2007 as image cls

* make lint

* correct num task types in descriptions

* add one model to models_to_annotate

* add mieb reference models

* update task types

* relabel to multilingual retrieval task type to align with paper

* fix reference and bibtex

* edit task list to match with final list

* add back agg task to reproduce table column in paper

* fix filtering and import

* update tests

* mieb lite add back missing tasks

* fix metadata test

* multi should have all 4 variants

* fix task counts

* lite has 10 task types

* fix visualSTS-17 lang splits

* Aggregate task can now use subsets & eval langs to filter TaskResults

* fix test and mark VisualSTS17 as multilingual

* fix tests

* add agg task running script

* add voyage meta

* fix citations

* capitalize

* add coarse/fine labels

---------

Co-authored-by: gowitheflow-1998 <jsbs54durham.ac.uk> ([`dea231b`](https://github.com/embeddings-benchmark/mteb/commit/dea231ba7be4343c37f4b56f2df4d67cb005df23))

Unknown

* Update tasks table ([`dbcbf54`](https://github.com/embeddings-benchmark/mteb/commit/dbcbf540ea3435bc6a2be1558f41e75483cad261))

Fix

* fix: Add Training data annotations (2173)

* redo to voyage to only training data

* Add training data annotation for Kalm embeddings 2168

* Add correct training data annotations to Stella 2164

* removed fiqa PL as it does not exist

* remove ArxivClusteringS2S.v2 as it does not exist

* Add training data annotation for GIST embedding 2166

* fix max tokens for kalm models 2162

* remove eli 5 ([`6cc1822`](https://github.com/embeddings-benchmark/mteb/commit/6cc18224970de37201a1a9d861a5a5f849bc21c0))

Unknown

* Update tasks table ([`331cded`](https://github.com/embeddings-benchmark/mteb/commit/331cded71efad7449fae52033d925002178873f9))

* Update FaMTEBRetrieval.py (2171)

The URL pointed to the settings page instead of the main repo URL. Now it is fixed. ([`8afb78a`](https://github.com/embeddings-benchmark/mteb/commit/8afb78ab2aa702f23db38a4bc29bdd614d50d28d))