Mteb

Latest version: v1.20.0

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 56 of 58

1.4.0

Feature

* feat: Added windows support by replacing pytrec-eval with pytrec-eval-terrier (292)

* ci: Added windows to test suite

* feat: Changed to pytrec-eval-terrier to add support for windows installs ([`fc0e105`](https://github.com/embeddings-benchmark/mteb/commit/fc0e105e737352e0afd3a144717e7129654f8c90))

1.3.4

Fix

* fix: Update MindSmallReranking.py to have the correct hf reference (303) ([`102e24e`](https://github.com/embeddings-benchmark/mteb/commit/102e24e093c4414e3ecef49cb9d0ba94995f2eb3))

1.3.3

Documentation

* docs: Added information related to the automatic release (290)

* docs: added information related to the automatic release

* docs: removed test-parallel from docs

* docs: minor additions to contributing guidelines

* ci: removed changelog

As it already present in the git releases

* Apply suggestions from code review

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com>

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`6821d23`](https://github.com/embeddings-benchmark/mteb/commit/6821d2324f41fed2bb686eedf074e4dc6803ece6))

Fix

* fix: fixed bug introduced in TatoebaBitextMining causing it to use a different dataset (297) ([`d0549a3`](https://github.com/embeddings-benchmark/mteb/commit/d0549a35f9697663a3e4bc6bdbe5990977d5c2e2))

* fix: Fixed mispecified rev. id for datasets (298)

* fix: fixed wrong rev. id for ToxicConversationsClassification

* fix: fixed wrong rev. id with RedditClusteringP2P ([`e1ae0d3`](https://github.com/embeddings-benchmark/mteb/commit/e1ae0d367eda70e6be31f0a43e20aed7cf75fedd))

1.3.2

Documentation

* docs: Update links in README.md (296) ([`76056b5`](https://github.com/embeddings-benchmark/mteb/commit/76056b5ba92dcbfe32d629897ab6d5db3a0861c4))

Fix

* fix: Added tasks from SEB (287)

* Added tasks from SEB

* docs: fix link

* fix: ran linting

* fix typing for 3.8

* fixed annotation for v3.8 ([`39cff49`](https://github.com/embeddings-benchmark/mteb/commit/39cff490157ae87d1cf62c77022f325be729bf04))

1.3.1

Fix

* fix: updated version in transition to semantic release ci ([`238ab82`](https://github.com/embeddings-benchmark/mteb/commit/238ab825e9b221c363589eed89273481e058c50f))

1.2.0

Updates
* 🇪🇸 New Spanish datasets thanks to violenil & team 🚀
* 🇫🇷 New French datasets thanks to GabrielSequeira & team + there's a [new French Overall leaderboard tab](https://huggingface.co/spaces/mteb/leaderboard) thanks to their massive benchmarking 🥇
* Retrieval has become much simpler and is now standardized to align with other tasks. You can [inspect all Retrieval datasets on the hub](https://huggingface.co/mteb), it is much easier to add new Retrieval datasets now & there are fewer dependencies making installing MTEB easier 😊 While this change is backward-compatible, it represents a significant change in how MTEB works, thus we decided to increment the minor for this release (1.1.2 -> 1.2.0).

What's Changed
* Add tasks for Spanish Embedding Evaluation by violenil in https://github.com/embeddings-benchmark/mteb/pull/227
* Extend MTEB with French datasets by GabrielSequeira in https://github.com/embeddings-benchmark/mteb/pull/218
* Remove HAGRID from french benchmark by MathieuCiancone in https://github.com/embeddings-benchmark/mteb/pull/235
* Fixed missing revision error on Norwegian Bitext Mining by x-tabdeveloping in https://github.com/embeddings-benchmark/mteb/pull/221
* Simplify retrieval by Muennighoff in https://github.com/embeddings-benchmark/mteb/pull/233

New Contributors
* GabrielSequeira made their first contribution in https://github.com/embeddings-benchmark/mteb/pull/218
* MathieuCiancone made their first contribution in https://github.com/embeddings-benchmark/mteb/pull/235

**Full Changelog**: https://github.com/embeddings-benchmark/mteb/compare/1.1.2...1.2.0

Page 56 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.