Mteb

Latest version: v1.20.0

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 31 of 58

1.11.2

Fix

* fix: Remove v_measures from metadata (775)

Update mteb_meta.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`56a5e10`](https://github.com/embeddings-benchmark/mteb/commit/56a5e10db4dc16e943a26da0de464986ecad77a9))

1.11.1

Fix

* fix: Convert StackExchangeClustering to fast (740)

* add MIRACLFrReranking dataset
* remove old fr file
* merge upstream
* Update StackExchangeClustering to Fast
* run lint
* add results
* add old task and superseed attr
* add old task and superseed attr
* added task metadata
* add scores
---------
Co-authored-by: Shreeya Dhakal <shreeyadhakalShreeyas-Mac-mini.local>
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`7c23ac9`](https://github.com/embeddings-benchmark/mteb/commit/7c23ac936be36ca09e07e8156cbb9a0bbcf9f2de))

Unknown

* Update tasks table ([`aeda96b`](https://github.com/embeddings-benchmark/mteb/commit/aeda96b872621a629ee76c37200c3fc9de10eab6))

* Update points table ([`5f93cc6`](https://github.com/embeddings-benchmark/mteb/commit/5f93cc679e4fd2e30215a2e58a77c3bba5dfbd94))

* Update tasks table ([`44a031c`](https://github.com/embeddings-benchmark/mteb/commit/44a031c1c12c9ed744e80f96daa8315df3263081))

* Update points table ([`411a0a9`](https://github.com/embeddings-benchmark/mteb/commit/411a0a98e1172fee37d4fbacc7afa89651b6bde5))

* Conversation Retrieval Task and TopiOCQA dataset (714)

* conv retrieval evaluation

* add encode_conversations to DenseRetrievalExactSearch

* remove duplication of default logic of conv -> query

* fix: queries has been converted from dict to list by this

* make it cross encoder compatible

* topiocqa dataset

* dont need a separate function

* metadata, full corpus

* more metadata

* baseline results

* add points

* update points ([`140de21`](https://github.com/embeddings-benchmark/mteb/commit/140de2139880e508e1697d782bbbb4a101e18c1f))

1.11.0

Feature

* feat: Standardized results output (759)

* feat: standardized results output

* minor fixes ([`1029a27`](https://github.com/embeddings-benchmark/mteb/commit/1029a271418e54cd48231cd77aaad90908da2b11))

1.10.18

Fix

* fix: Add JMTEB Clustering datasets (768)

* Add JMTEB Clustering datasets
* Add points
* Add points for review ([`970b03c`](https://github.com/embeddings-benchmark/mteb/commit/970b03ca7fd1898b4a5e47fea775fa72b6f0f668))

Unknown

* Update tasks table ([`4124a5b`](https://github.com/embeddings-benchmark/mteb/commit/4124a5b09bfe41180598709dfba5bd1831994d0f))

* Update points table ([`ee6ba43`](https://github.com/embeddings-benchmark/mteb/commit/ee6ba43c6dc0bf6bba33cbbc6a90b23eda491894))

* Update tasks table ([`6befb3b`](https://github.com/embeddings-benchmark/mteb/commit/6befb3be0ddfb0ba184eb186f011fb2d556ad36d))

1.10.17

Fix

* fix: Add JSICK dataset (769)

* Add JSICK dataset
* Add points
* Add points for review
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`755fe35`](https://github.com/embeddings-benchmark/mteb/commit/755fe35c3a145049b38e3ee145dcc6964786e164))

Unknown

* Update points table ([`47f7736`](https://github.com/embeddings-benchmark/mteb/commit/47f7736758caaeaf595270fda0e7592b621a6fa2))

1.10.16

Fix

* fix: Convert SIB200Class to SIB200Cluster (767)

* missing change from pr$757
* SIB200ClusteringFast task working
* add e5 small results
* add results
* add points
* review points ([`211f339`](https://github.com/embeddings-benchmark/mteb/commit/211f33985dae80f6102b830fad8cd2655e94cb76))

Unknown

* Update tasks table ([`1a39d2d`](https://github.com/embeddings-benchmark/mteb/commit/1a39d2d839549d707a3b68d0bb26652b2a3d1af5))

* Update points table ([`4e1cbda`](https://github.com/embeddings-benchmark/mteb/commit/4e1cbda69c3c7918df24ce4d00ff25a654709520))

Page 31 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.