Mteb

Latest version: v1.20.0

Safety actively analyzes 681881 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 58

1.18.9

Fix

* fix: Disable `rich` output with `verbosity=0` on `evaluation.run` (1395)

* feat: verbose=0 now supress rich console output

* fix: removed unnecesary list comprenhension ([`1bb1ca3`](https://github.com/embeddings-benchmark/mteb/commit/1bb1ca34fbf220c07d67443ba37f49fa16291b04))

1.18.8

Fix

* fix: Update logging verbosity levels in MTEB (1384)

* Fix verbosity handling in MTEB.py for consistent logging

* updates

* update docstrings

* linting code ([`35daf58`](https://github.com/embeddings-benchmark/mteb/commit/35daf58578870678eb08e3d6230ad516c01fec83))

1.18.7

Fix

* fix: Leaderboard UI improvements (1370)

* Added elementary search bar with RegEx functionality

* Improved layout

* Table improvements, adjusted column width and added links

* Update benchmark filter description

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

* Added instructions on multiple search queries

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`92fe9cb`](https://github.com/embeddings-benchmark/mteb/commit/92fe9cbd6bde7800a987185f0e91bc23ad8c2eb6))

1.18.6

Fix

* fix: Integrate prompts to task metadata (1300)

* init

* add DatasetDict

* add classification

* add clustering

* add pair classification

* add retrieval

* add all prompts

* start integrating prompts

* refactor instruct models

* lint

* fix test

* fix

* fix no prompt in prompt dict

* add more logging

* add more logging

* Apply suggestions from code review

Co-authored-by: Isaac Chung <chungisaac1217gmail.com>

* fix code review

* fix use_instructions

* add log if instruction template not set

* fix metadata

* lint

* fix brazilian

* remove MetadataDatasetDict

* rollback test metadata

---------

Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`029d378`](https://github.com/embeddings-benchmark/mteb/commit/029d378b2c17d7e05a4c9c30a17966917cb83a33))

1.18.5

Fix

* fix: Speed up leaderboard by caching and skipping validation (1365)

* Made loading and filtering faster by removing unnecessary validation

* Made select_tasks faster by removing validation

* Added caching to leaderboard

* Ran linting

* Added missing future import ([`f1bc375`](https://github.com/embeddings-benchmark/mteb/commit/f1bc3758d6e1cc91fbe22b26dcbd1cfe3b640f06))

1.18.4

Fix

* fix: make sure test is the default split for FEVER (1361)

The other splits can still be run as long as they are specified. ([`d9626ab`](https://github.com/embeddings-benchmark/mteb/commit/d9626abbc5d438024a21e7f21a29d4741bb94188))

Page 3 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.