Mteb

Latest version: v1.20.0

Safety actively analyzes 681881 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 7 of 58

1.15.1

Fix

* fix: Add Touche2020v3 and JMTEB (1262)

* add datasets

* fix metrics

* add Touche2020v3

* fix metadata

* Apply suggestions from code review

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com>

* upd name and supress

* add benchmark class

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`5074918`](https://github.com/embeddings-benchmark/mteb/commit/507491884b0bb9e4599594740bb9886ba7b9b2a7))

Unknown

* Update tasks table ([`7a55c85`](https://github.com/embeddings-benchmark/mteb/commit/7a55c85cd4f5aab8ae36313f222778fdb4683216))

1.15.0

Documentation

* docs: Update mteb(eng) calculation (1258)

* Update mteb(eng) calculation

* Fixed citations

* Update MTEB(eng) + MTEB(multilingual) ([`11518ed`](https://github.com/embeddings-benchmark/mteb/commit/11518edd03b916a63e84505592f0d1a32a058d49))

* docs: Update affiliation (1248)

* Update points.md

* Update points.md

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`647c295`](https://github.com/embeddings-benchmark/mteb/commit/647c295c4dc178f902ab4633d4e1d6e8213487eb))

Feature

* feat: leverage SentenceTransformers&39; query/passage specific prompts (1221)

* feat: leverage SentenceTransformer models&39; query/passage specific prompts

* refactor: remove E5Wrapper

fix: wrong e5 revisions

* fix: default prompt_type to None

* fix: e4ce987 revision no longer exists for multilingual-e5-small on the Hub

* fix: keep `prompt_name` in kwargs when model doesn&39;t have a `prompts` attr

* feat: use Enum for `prompt_type`

* docs: specify how to use prompts with Sentence Transformers

* feat: readd arctic models due to metadata ([`c809b84`](https://github.com/embeddings-benchmark/mteb/commit/c809b84d3c7b5bf6f5bca6bbbbdac313e9327d2e))

1.14.26

Fix

* fix: Add listing all available benchmarks CLI option (1256)

* add benchmarks.md in README

* add cli option

* add benchmark cli test case

* correct typo ([`5e1e290`](https://github.com/embeddings-benchmark/mteb/commit/5e1e29064ac6bb49a09c3dbb5d655c0d2b5379e1))

1.14.25

Fix

* fix: Get meta from CrossEncoder (1255)

* remove indent after return

* handle cross encoders for model meta

* make lint

* update filename since we now have model name ([`0ad5dad`](https://github.com/embeddings-benchmark/mteb/commit/0ad5dad6591ccbfbf3304525ea20fad9c2710cce))

1.14.24

Documentation

* docs: Small point changes & more contributors (1254)

* Update points.md

* Fix format

* Fix attribution ([`0d7664d`](https://github.com/embeddings-benchmark/mteb/commit/0d7664d22cf4eeedb5f84e162ab3aa0115dc7c7c))

Fix

* fix: Downsample large retrieval datasets (1236)

* most tasks

* lint

* fix other issues

* refactor

* lint and docs

* add polish

* keep case sensitive mteb paths

* add potential points

* fix points

* fix test about metadata

* update tasks and stats

* lint ([`b754f1a`](https://github.com/embeddings-benchmark/mteb/commit/b754f1a578cc6f6868f0666e7a0e2ac9158fe13c))

Unknown

* Update tasks table ([`e875401`](https://github.com/embeddings-benchmark/mteb/commit/e8754010b6b47118d7d6553098b5e37860ec5414))

* Update points table ([`a155401`](https://github.com/embeddings-benchmark/mteb/commit/a15540116446c6e1d3e0878c92eda3483ae1584a))

* Update points table ([`55e18a8`](https://github.com/embeddings-benchmark/mteb/commit/55e18a80bd91474eff286042c538462c04e034d6))

1.14.23

Documentation

* docs: Added coordination point for Jimmy Lee (1253)

docs: Added coordination point for Jimmy lee for his work on the coordination of Crystina and Nandan ([`6b27ce0`](https://github.com/embeddings-benchmark/mteb/commit/6b27ce0a589e0e8f1370dacd414fa61cf882fb8c))

* docs: Update affiliation (1247)

Update points.md ([`45de3ec`](https://github.com/embeddings-benchmark/mteb/commit/45de3eca1c2487573104e6facd113d2c40907a0f))

Fix

* fix: Add multilingual Benchmark (1252)

* fix: Add multilingual bench

* Update mteb/benchmarks/benchmarks.py

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com>

* format

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`6a6259c`](https://github.com/embeddings-benchmark/mteb/commit/6a6259c39eda1d831073b7516ec158c617f782f3))

Unknown

* Update points table ([`4dbf784`](https://github.com/embeddings-benchmark/mteb/commit/4dbf78447a67bd9a3b14fd50bdb1cb4466fe1f95))

* Update points table ([`35abd84`](https://github.com/embeddings-benchmark/mteb/commit/35abd8495faa10f165ca108ca84baecb60e365a6))

* Add final author list ([`9ac24b7`](https://github.com/embeddings-benchmark/mteb/commit/9ac24b7b27d6dc6daf0ded3f91bac1b30bc62769))

* Merge branch &39;main&39; of https://github.com/embeddings-benchmark/mteb ([`8582244`](https://github.com/embeddings-benchmark/mteb/commit/8582244752e341c9a17e3121b7b82d4f82b7346b))

* Added author-information ([`c02c8e5`](https://github.com/embeddings-benchmark/mteb/commit/c02c8e5bbe575306a0c5f6b881a9958cfad2e84e))

Page 7 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.