Mteb

Latest version: v1.20.0

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 14 of 58

1.12.84

Ci

* ci: Splitting doc CI in two to ensure that it runs on PRs AND on main (1096)

* ci: Splitting doc CI in two to ensure that it runs on PRs AND on main

* minor fixes to clarify intent ([`304bac0`](https://github.com/embeddings-benchmark/mteb/commit/304bac040ce7133a049a14b71ec587375e7c003c))

Fix

* fix: Added fix for voyage models to handle too large batches (1098)

Additonally also added voyage multilingual. ([`2f25626`](https://github.com/embeddings-benchmark/mteb/commit/2f25626f2c66c17477b40c81de95dc43a6cfd885))

* fix: Added misisng license (1097) ([`81f0e22`](https://github.com/embeddings-benchmark/mteb/commit/81f0e223d24c121203af27164e89fa37cb6f66b5))

Unknown

* Update tasks table ([`b55eed5`](https://github.com/embeddings-benchmark/mteb/commit/b55eed545a93d22cc7a7307d19b10e5fbfa312fa))

1.12.83

Fix

* fix: update lang codes for language classification (1094)

Add language classification ([`930e23c`](https://github.com/embeddings-benchmark/mteb/commit/930e23c583b6a614d4f70542ddecbf5f73cebde5))

1.12.82

Fix

* fix: Add google API models (1087)

* Add google API models

* fix based on revisions ([`11443dc`](https://github.com/embeddings-benchmark/mteb/commit/11443dc9c0a9f4c5fbf686dffbf0b9a6f63493fe))

1.12.81

Fix

* fix: Add bm25s as a model for retrieval (1082)

* add bm25s as a model
* getting bm25s working
* add nf corpus results
* add as optional dependecies
* add bm25 to make install-for-tests
* move results to results repo
* add run script
* make test passing
* make lint
* types

Co-authored by: malteos <githubi.mieo.de> ([`5269f2c`](https://github.com/embeddings-benchmark/mteb/commit/5269f2c4538cc3b0e691de235d1cd2011e1bab5a))

1.12.80

Ci

* ci: fix ci docs to work on prs and in main (1084)

* ci: allow docs ci to be run by contributors on PRs

* ci: Add missing &34;fi&34; at the end ([`c977d35`](https://github.com/embeddings-benchmark/mteb/commit/c977d35996c12ee94546470bb7875d68bb304084))

* ci: allow docs ci to be run by contributors on PRs (1081) ([`db45092`](https://github.com/embeddings-benchmark/mteb/commit/db45092f31a1be05f264a0752fa68964a35b5927))

* ci: run docs ci on PRs (1078) ([`bf02080`](https://github.com/embeddings-benchmark/mteb/commit/bf02080f6062bc28bff597663ed1759a63233535))

Fix

* fix: ensure that CQADupstackRetrieval is included in results if possible (1079)

* move mmteb script into correct folder

* remove unec file

* add results to gitignore

* fix: ensure that CQADupstackRetrieval is included in results if possible

* remvoe cqadupstack script

* Added fixes based on corrections ([`3109b4d`](https://github.com/embeddings-benchmark/mteb/commit/3109b4deaf2ca080036240d4f734b304da7fc23a))

Unknown

* Add support for the Bright benchmark (971)

* Bright

* Update mteb/tasks/Retrieval/eng/BrightRetrieval.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/abstasks/TaskMetadata.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/tasks/Retrieval/eng/BrightRetrieval.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/tasks/Retrieval/eng/BrightRetrieval.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* Update mteb/tasks/Retrieval/eng/BrightRetrieval.py

Co-authored-by: xiamengzhou <296337231qq.com>

* Create run_mteb_bright.py

* Fix format

* Fix splits

* Update metadata

* Rmv newline

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>
Co-authored-by: xiamengzhou <296337231qq.com>
Co-authored-by: hongjin-su <114016954+hongjin-suusers.noreply.github.com>
Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`e05c53c`](https://github.com/embeddings-benchmark/mteb/commit/e05c53cbc7a5be62090de156a033689f16cab040))

1.12.79

Fix

* fix: Added models x tasks which haven&39;t yet been run (1038)

* Added models x tasks which haven&39;t yet been run

* removed duplicate citations

* adapt to new results repo structure

* Rename PawsX to PawsSXPairClassification

* rename PawsX class

* updated missing tasks

* Updated missing tasks

* tmp

* format ([`ae2e2b7`](https://github.com/embeddings-benchmark/mteb/commit/ae2e2b7c8140176f0aa4f3d7d90856f5acbbabb6))

Page 14 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.