Mteb

Feature

* feat: update English benchmarks and mark MMTEB benchmarks as beta (1341)

* feat: update English benchmarks and mark MMTEB benchmarks as beta

* Added summEvalv2

* Update docs with new MTEB_EN_MAIN rename ([`61371dd`](https://github.com/embeddings-benchmark/mteb/commit/61371dd2db8e3c3a5c7ecd4bb9afff973f7d01d8))

Feature

* feat: Update metadata for all models (1316)

* Added model meta

* format

* fixed metadata

* Metadata update for voyage models

* Update mteb/models/cohere_models.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* Update mteb/models/cohere_models.py

Co-authored-by: Roman Solomatin <samoed.romangmail.com>

* Added corrections from review

* fix spelling error

---------

Co-authored-by: Roman Solomatin <samoed.romangmail.com> ([`f8fed9b`](https://github.com/embeddings-benchmark/mteb/commit/f8fed9b1567982d8dd590a3a08262537427fcf09))

Unknown

* WIP: Leaderboard UI improvements (1320)

* Fixed typos in task_results

* Fixed typos in task_results

* Added Tailwind, reorganized layout and fixed scrolling

* Ran linting

* Removed faux benchmark

* Updated layout

* Changed table number format

* Table highlights highest values by making them bold

* Added rank to table, removed organization from model_name

* Added mean rank to table

* Ran linting ([`5af36c5`](https://github.com/embeddings-benchmark/mteb/commit/5af36c515d8e98f1eabe35a11558b1317a93c0f8))

* Cache the embeddings when requested (1307)

* add caching

* update test to use close

* change from json to pkl

* fix for window

* cleanup on Windows again

* infer dimension

* move cachewrapper

* add wrapper

* fix

* updates

* fix tests

* fix lint

* lint

* add test ([`650e8b8`](https://github.com/embeddings-benchmark/mteb/commit/650e8b89ba856b21869e3fa6d5921ed7d9ed8d07))

* Update tasks table ([`4a04042`](https://github.com/embeddings-benchmark/mteb/commit/4a040426c8744c851e877a923e940b30b9714b14))

* Add multilingual mFollowIR dataset (1308)

* add mFollowIR

* paper name

* edit warning->info

* convert to parquet

* lint ([`b580b95`](https://github.com/embeddings-benchmark/mteb/commit/b580b95fc91a7e7e675d27c3ae9a9df64ddad169))

Fix

* fix: Add implementations of common reranker models (1309)

* init

* revert

* revert

* add metadata

* lint

* add reqs

* change to float16

* benchmark lint fix ([`f5f90d3`](https://github.com/embeddings-benchmark/mteb/commit/f5f90d3df694b47a7ca81d46c95f1dd2b389ca06))

Fix

* fix: Re-upload dataset to hub to avoid using script upload (1322)

* fix dataset upload

* add linting ([`f00a262`](https://github.com/embeddings-benchmark/mteb/commit/f00a2622821eeec68e191561ca9f2b346f0a5dc6))

Unknown

* Update tasks table ([`e5b6c12`](https://github.com/embeddings-benchmark/mteb/commit/e5b6c12b2578c5421dce46df259c6327342b7681))

Fix

* fix: remove duplicate multilingual ([`2f14519`](https://github.com/embeddings-benchmark/mteb/commit/2f1451955da42070bf6aea4c317c4bc3da755a38))

Fix

* fix: Add Slovak Hate Speech and Offensive Language Dataset (1274)

* Add Slovak Hate Speech and Offensive Language
Dataset

This commit introduces the Slovak Hate Speech and Offensive Language Database to MTEB. The dataset includes posts from a social network, annotated by humans for hate speech and offensive content. Additionally, the corresponding task has been added to the tasks.md table to reflect this update.

* Add Slovak Hate Speech and Offensive Language Dataset
- Updated __init__.py to include the new SlovakHateSpeechClassification task.
- Modified SlovakHateSpeechClassification.py as per review suggestions to enhance functionality and readability.

* Did requested changes:
- Updated __init__.py to include the new SlovakHateSpeechClassification task.
- Modified SlovakHateSpeechClassification.py as per review suggestions to enhance functionality and readability.

* resolve linting issues by running `make lint` ([`f3d8014`](https://github.com/embeddings-benchmark/mteb/commit/f3d8014fc91dfdf400ab7713683afe4cf785cabf))

Unknown

* WIP: Leaderboard UI improvements (1312)

* Fixed typos in task_results

* Fixed typos in task_results

* Added Tailwind, reorganized layout and fixed scrolling

* Ran linting ([`bd5ee9e`](https://github.com/embeddings-benchmark/mteb/commit/bd5ee9eca947a656f6ed0d83971615d53a85475a))

* Update tasks table ([`0d86753`](https://github.com/embeddings-benchmark/mteb/commit/0d8675338a0c99a606daa19bbc2a35d904b5c93f))