Mteb

Fix

* fix: Add `ModelMeta` license & custom validations (2293)

* license validation

* move licenses

* update imports

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`5dce601`](https://github.com/embeddings-benchmark/mteb/commit/5dce60125e56b1719d33f4c4a3e4a35ea7da7bff))

Fix

* fix: Added Filter Modality (2262)

* Added Filter Modality

* resolve suggestions

* make lint

* make sure test pass

* make lint

* added exclusive_modality_filter and unit tests

* Integrate tests on overview.py

* Update tests/test_overview.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* added task related to image modality

* Update mteb/abstasks/AbsTask.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/abstasks/AbsTask.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* update overview..py

* make lint

* update documentation

---------

Co-authored-by: Roman Solomatin <samoed.romangmail.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`f840f7d`](https://github.com/embeddings-benchmark/mteb/commit/f840f7d51fce640d37507f2457636db3c535b05a))

Ci

* ci: run test_dataset_on_hf separately (2201)

* dont run test_dataset_on_hf in every pr

* lint

* Update call pytest test_datasets

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update tests/test_tasks/test_all_abstasks.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* not datasets for test

* run dataset loading test for push or pull_request

* apply feedback

---------

Co-authored-by: sam021313 <40773225+sam021313users.noreply.github.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`55b9a0e`](https://github.com/embeddings-benchmark/mteb/commit/55b9a0efef5198c37fd39af2b225b721dbba1b2f))

Fix

* fix: Run remaining MIEB desc stats (2288)

* run Vidore

* GLDv2

* run the rest

---------

Co-authored-by: Isaac Chung <isaachn496lf4f9.lan> ([`e628bce`](https://github.com/embeddings-benchmark/mteb/commit/e628bceb5dd05cf9a71c69cee94cf17b9da64c9c))

Unknown

* Update tasks table ([`dd7008d`](https://github.com/embeddings-benchmark/mteb/commit/dd7008dc2145838fed26f7128036505b35c93de7))

* update link (2281) ([`9513f15`](https://github.com/embeddings-benchmark/mteb/commit/9513f1546bb650684847c7354a7aaed0f18c3aa4))

* add gemini-embedding-exp-03-07 (2279)

* add gemini-embedding-exp-03-07

* remove space for lint

* lint fix ([`fb1b04c`](https://github.com/embeddings-benchmark/mteb/commit/fb1b04c47823e92d6ebb90d638ab75a59b34baeb))

Fix

* fix: Formatting issue in Performance Plot (2237)

* Formatting issue in Performance Plot

* make lint

* added function for better code readability ([`c456111`](https://github.com/embeddings-benchmark/mteb/commit/c456111b98a1e0e4be13f739ce360404f2a74461))

Documentation

* docs: Update description of EURLex (2231) ([`3a9d271`](https://github.com/embeddings-benchmark/mteb/commit/3a9d271e9cacfd4c4a3072f09a08630008f44b11))

Fix

* fix: Add WebFAQ Retrieval dataset (2236)

* Add WebFAQ Retrieval dataset

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de>

* Small change WebFAQRetrieval.py

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de>

* Add remaining languages to WebFAQ Retrieval task

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de>

* Add descriptive stats

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de>

---------

Signed-off-by: Michael Dinzinger <michael.dinzingeruni-passau.de> ([`9d6e1a9`](https://github.com/embeddings-benchmark/mteb/commit/9d6e1a9ed97d29789f87017f4d51c23cd7aa6213))

Unknown

* Update tasks table ([`a67c4d0`](https://github.com/embeddings-benchmark/mteb/commit/a67c4d0773483218eecc6014f0c244b7f049389d))

* Add Arabic-Triplet-Matryoshka-V2 model metadata to MTEB (2270)

* Add Arabic-Triplet-Matryoshka-V2 model metadata to MTEB

* Update memory_usage_mb with correct calculated value

* Update mteb/models/Arabic_Triplet_Matryoshka_V2.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* Update mteb/models/Arabic_Triplet_Matryoshka_V2.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* remove comments

* added correct memory usage

* Update mteb/models/Arabic_Triplet_Matryoshka_V2.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* Apply linter fixes with ruff

* Update mteb/models/Arabic_Triplet_Matryoshka_V2.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* Update mteb/models/Arabic_Triplet_Matryoshka_V2.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* Add Arabic_Triplet_Matryoshka_V2 to overview.py

* Rename model file to ara_models.py and update imports

---------

Co-authored-by: Roman Solomatin <samoed.romangmail.com> ([`f964829`](https://github.com/embeddings-benchmark/mteb/commit/f96482924076cbe4a195e7bd1850ca79494a7c49))

* Fix `calculate_memory_usage_mb` in adding_a_model.md (2271) ([`a4456ec`](https://github.com/embeddings-benchmark/mteb/commit/a4456ec1739f021df22b28982dff8a5883cd68d8))

* Update tasks table ([`d8e73e7`](https://github.com/embeddings-benchmark/mteb/commit/d8e73e7d67412f9ce91a6bef36067e4222934470))

* misc: Add rest of the vision centric and compositionality descriptive stats (2267)

add the rest ([`43cb205`](https://github.com/embeddings-benchmark/mteb/commit/43cb205b67c3658c48422c57f6a9543f42376239))

* Update tasks table ([`e81d109`](https://github.com/embeddings-benchmark/mteb/commit/e81d1097e4cae5fef116764cb57e04343023c21e))

* misc: Run Any2AnyRetrieval descriptive stats (2223)

* run a few datasets

* add a few more

* run more tasks

* add more datasets

* remove pdb

* remove newline

* add more datasets ([`40b89db`](https://github.com/embeddings-benchmark/mteb/commit/40b89dba5e3e3901098d7fe3da966f56e03f7cfe))

* Remove overlapping legends from radar chart (2195)

* Remove overlapping legends from radar chart

* ensure graph is not blocked

* Overlapping legend issue of Radar Chart ([`6129282`](https://github.com/embeddings-benchmark/mteb/commit/612928248bb423226bfa54f67ff962f1526d8bae))

* Automatically add similar tasks to training_tasks (2228)

* refactor dataset checking

* increase timeout

* increase timeout

* remove timeout

* start

* automatically find datasets

* update comment

* fix aggregate task metadata

* fixes

* lint

* rename

* update fetch check ([`7f7d3e8`](https://github.com/embeddings-benchmark/mteb/commit/7f7d3e8e3908f2ffbf6a68d9ca1f71607e3e9d77))

* Add comment to `voyage-3-m-exp` model (2229)

* remove model size from voyage-3-m-exp model

* Update mteb/models/voyage_models.py

* Update mteb/models/voyage_models.py ([`a87927b`](https://github.com/embeddings-benchmark/mteb/commit/a87927bf6914b516b541dfb66a6da4236629ffe8))

Fix

* fix: Add training data annotations to uderver-bloom models (2210)

* fix: Add training data annotations to uderver-bloom models

fixes 2193

* fix: add mixedbread

---------

Co-authored-by: Márton Kardos <power.up1163gmail.com> ([`ee514cb`](https://github.com/embeddings-benchmark/mteb/commit/ee514cb0d491809f12d581d5f2a5a8c596a8269a))

Unknown

* Update tasks table ([`cc47225`](https://github.com/embeddings-benchmark/mteb/commit/cc472258dfb70bc005a53f8a40b46df296101b39))

* Descriptive stats functions for Any2AnyMC and ImageTextPC (2197)

* Add Any2AnyMC descriptive stats

* Add descriptive stats function for ImageTextPC

* add descriptive stats examples

* linter

* update multi choice descriptive stats ([`3e991bd`](https://github.com/embeddings-benchmark/mteb/commit/3e991bdf401b669c7f5d57baa5c172857cf3f9e8))

* Change `dataset on HF` test to use official api (2213)

* refactor dataset checking

* increase timeout

* increase timeout

* remove timeout ([`c5fded2`](https://github.com/embeddings-benchmark/mteb/commit/c5fded2a2a461e8fe53bb8ded25f1523217383a5))

* Add LLM2CLIP (OpenAI variants) (2222)

* model loading and get_text_embeddings

* add image_emb, fused_emb, and calc probs methods

* add b16 model

* add llm2clip_openai_l_14_224 (not working yet)

* got llm2clip_openai_l_14_224 working

* make lint

* add training sets and allow py files ([`4ee4e7c`](https://github.com/embeddings-benchmark/mteb/commit/4ee4e7c35adcbe151925939a6fc6dbf9a4ed0fed))