Mteb

Latest version: v1.20.0

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 44 of 58

1.7.24

Fix

* fix: added the first thai classification dataset (538)

* added thai sentiment dataset

* all changes based on comments made. models rerun and points added

* Update mteb/tasks/Classification/tha/wisesight_sentiment_classification.py

* Update docs/mmteb/points/538.jsonl

---------

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`5f5935c`](https://github.com/embeddings-benchmark/mteb/commit/5f5935c93baaff217684da160a010b2205e7a075))

Unknown

* Update tasks table ([`e988b7b`](https://github.com/embeddings-benchmark/mteb/commit/e988b7bd827fdf4b2eebb7656dfe1944e3cc44b0))

* Update points table ([`c7c7758`](https://github.com/embeddings-benchmark/mteb/commit/c7c775847145353a55425995fbccc3ec9160138b))

1.7.23

Fix

* fix: Add Financial Phrasebank dataset (499)

* add dataset
* add points
* PR comments
* add rough dates based on paper
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`c79a509`](https://github.com/embeddings-benchmark/mteb/commit/c79a509b0f17bdd4e402126109cb8280fd5fdac5))

Unknown

* Update tasks table ([`b2dc594`](https://github.com/embeddings-benchmark/mteb/commit/b2dc5943781ca99cb1d38e81f59a7873d1d188f2))

* Update points table ([`4e398be`](https://github.com/embeddings-benchmark/mteb/commit/4e398bee8a8462d526221dfcb51c48a9e6b20135))

1.7.22

Documentation

* docs: Updated ordering of languages ([`6faae86`](https://github.com/embeddings-benchmark/mteb/commit/6faae8658f47d5bebc79a665529740b472519856))

Fix

* fix: AddingGeorgian Sentiment Classification (534)

* Adding First Georgian Dataset
* Points
* Update __init__.py
* Update __init__.py ([`31d3b57`](https://github.com/embeddings-benchmark/mteb/commit/31d3b5794a92430b6f2049e3c224cf89a3ba24a6))

* fix: Update previous tasks and scores using new subsampling function (527)

* update sampling on old tasks

* update paraphrase minilm v12 results

* chore: add linting

* fix: update missing results

* fix: update ToxicChatClassification languages

* chore: add linting

* chore: add points ([`7b595d7`](https://github.com/embeddings-benchmark/mteb/commit/7b595d7ba1d60423a882af328725ad641008db2e))

Unknown

* Update tasks table ([`d4ba114`](https://github.com/embeddings-benchmark/mteb/commit/d4ba1148341b41acfda60ad0cdc015684803bf81))

* Update points table ([`d08dc76`](https://github.com/embeddings-benchmark/mteb/commit/d08dc76abb41c42ac26ecca4fb7dba7c70e93081))

* Update points table ([`768b7a2`](https://github.com/embeddings-benchmark/mteb/commit/768b7a241ae62bf97521fd3671741c961ec84fec))

* Merge branch &39;main&39; of https://github.com/embeddings-benchmark/mteb ([`f3044b1`](https://github.com/embeddings-benchmark/mteb/commit/f3044b1119bc06a0ee6becb983612d9470233051))

* Merge branch &39;main&39; of https://github.com/embeddings-benchmark/mteb ([`10f3d4b`](https://github.com/embeddings-benchmark/mteb/commit/10f3d4b369e3e94bb82b3f0dc9d7436b74e9791a))

1.7.21

Ci

* ci: Fix create tasks table loop by sorting languages (541)

sort languages ([`ed16cbf`](https://github.com/embeddings-benchmark/mteb/commit/ed16cbffd78886b9accb26feebd50105a3c933c7))

Fix

* fix: First Turkish Retrieval dataset (533)

* First Turkish Retrieval dataset
* linted
* linted again
* Update mteb/tasks/Retrieval/tur/TurHistQuad.py
Co-authored-by: Isaac Chung <chungisaac1217gmail.com>
* Only consider eval_splits and points
* Update docs/mmteb/points/533.jsonl
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`6607f2f`](https://github.com/embeddings-benchmark/mteb/commit/6607f2fc80620c0e6e841e5fb7d3007b68116f04))

* fix: Added Sentiment Analysis Bengali Dataset (536)

* Added Hindi sentiment analysis dataset
* Made changes based on comments and added points on points table
* linted correctly
* bengali sentiment analysis dataset
* Added Sentiment Analysis Bengali Dataset
* deleted old hindi sentiment files
* removed hindi points
* updated all references, rerun tests, and added points ([`ba9bcaa`](https://github.com/embeddings-benchmark/mteb/commit/ba9bcaa2dc976de407b05da86176d8929ee5e96e))

* fix: Add Armenian Paraphrase Dataset (537)

* First Armenian Dataset
* added points ([`37bf08e`](https://github.com/embeddings-benchmark/mteb/commit/37bf08ebd59fedeead29ced1293095a25564447e))

* fix: Added encoder interfaces (469)

* docs: Added script for creating point

* ci: enable linting on all PRs

* ci: Added missing dependency

* docs: Added points

* fix: Added encoder interfaces

* Update mteb/encoder_interface.py

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com>

---------

Co-authored-by: Niklas Muennighoff <n.muennighoffgmail.com> ([`7625b1d`](https://github.com/embeddings-benchmark/mteb/commit/7625b1d15cdc55248ecc2cc9873732c4dd3f9cc0))

* fix: add Multilingual Hate Speech detection task (439)

* resolve conflicts

* remove legacy results

* remove legacy itahate results

* load from new mteb-hosted dataset and align metadata

* add results

* complete rebase

* create points file

* remove old ita hatespeech results

* restore correct init file for classification tasks

* rerun with all languages

* add points ([`eee7175`](https://github.com/embeddings-benchmark/mteb/commit/eee71755a403143f21c2fd09518742c689a36681))

Unknown

* Update tasks table ([`2b4bfbd`](https://github.com/embeddings-benchmark/mteb/commit/2b4bfbdf7e9e7077d54bccec8c52a34d592f84e6))

* Update tasks table ([`4fc2461`](https://github.com/embeddings-benchmark/mteb/commit/4fc2461c212b9e1b2b182b33bcbedbe7253734df))

* Update points table ([`3895d96`](https://github.com/embeddings-benchmark/mteb/commit/3895d962a2b11b8d0b4ab61652888929bdbf35ad))

* Update tasks table ([`38bbc87`](https://github.com/embeddings-benchmark/mteb/commit/38bbc8756dbfd0d5dfdbc70d6373f784ef30c8f4))

* Update tasks table ([`2337201`](https://github.com/embeddings-benchmark/mteb/commit/233720150875807217b555fd4281641026f22221))

* Update tasks table ([`ee96dc8`](https://github.com/embeddings-benchmark/mteb/commit/ee96dc87f0bfd1383eef3253fe95d8f0db1887d1))

* Update tasks table ([`39740e0`](https://github.com/embeddings-benchmark/mteb/commit/39740e02eb3cbd6a643f606dc8f80b45df93963a))

* Update tasks table ([`69f5b0a`](https://github.com/embeddings-benchmark/mteb/commit/69f5b0a8f9f048eb699b53cc91bb9ec84436578e))

* Update tasks table ([`4e3c3ec`](https://github.com/embeddings-benchmark/mteb/commit/4e3c3ec6da15ffbb9d3e3ba766301e49b425a015))

* Update tasks table ([`f741ff1`](https://github.com/embeddings-benchmark/mteb/commit/f741ff122d031954955de72f407116f1566c24f6))

* Update tasks table ([`5ea9a78`](https://github.com/embeddings-benchmark/mteb/commit/5ea9a78ecc2cf4d185cbd2e35e8f7781d5762048))

* Update tasks table ([`947779e`](https://github.com/embeddings-benchmark/mteb/commit/947779e15b247940f1c34df02016cdeb4c490226))

* Update tasks table ([`a0611ef`](https://github.com/embeddings-benchmark/mteb/commit/a0611ef15a41755d2e324cd63399e2b3574e0420))

* Update tasks table ([`5e6d503`](https://github.com/embeddings-benchmark/mteb/commit/5e6d50362b83b504da9edca2f57e60984368291d))

* Update points table ([`2d3a46f`](https://github.com/embeddings-benchmark/mteb/commit/2d3a46f8d0c6b85e0d9218735240709e0d906da0))

* Update tasks table ([`98aa8ec`](https://github.com/embeddings-benchmark/mteb/commit/98aa8ec89e2f91e797fe6585fd327317748fd36c))

* Update tasks table ([`9bbc86e`](https://github.com/embeddings-benchmark/mteb/commit/9bbc86e0b5b42cf5623d946ba2bc795459ded869))

* Update tasks table ([`39394ea`](https://github.com/embeddings-benchmark/mteb/commit/39394ea58a68edf887ce895f4be0c175d3545331))

* Update points table ([`6a44ef5`](https://github.com/embeddings-benchmark/mteb/commit/6a44ef55c3ede09dda569d5834ece7c0f3dc668e))

* Update points table ([`f14548b`](https://github.com/embeddings-benchmark/mteb/commit/f14548bb096388525ab561bc7836e63d5f26f1b3))

* Update tasks table ([`542ce19`](https://github.com/embeddings-benchmark/mteb/commit/542ce19aeb26b6ab551b39199d0482b849d3cf64))

1.7.20

Documentation

* docs: LB tab instructions (531)

* LB tab instructions

* Add LB Tab instructions ([`e4e627d`](https://github.com/embeddings-benchmark/mteb/commit/e4e627deef6099d61d062a4297562bc4e7904ef9))

Fix

* fix: add Clustering dataset for Indic languages (532)

* add Indic clustering dataset

* update module import statement

* add points for the contribution ([`dc9ba24`](https://github.com/embeddings-benchmark/mteb/commit/dc9ba24bfa48774e488df671bc2fb6df0080c2b3))

Unknown

* Update tasks table ([`76771c0`](https://github.com/embeddings-benchmark/mteb/commit/76771c0a9e4faff39abc540d1f5dda1e016f2b01))

* Update points table ([`e029d73`](https://github.com/embeddings-benchmark/mteb/commit/e029d736f9ac2159134c6bc84cd090f332e35a05))

* Update tasks table ([`a61de4c`](https://github.com/embeddings-benchmark/mteb/commit/a61de4c011db0f6df2c96311cb535ec05e3b4f00))

* Update tasks table ([`398748f`](https://github.com/embeddings-benchmark/mteb/commit/398748f038d275ed03d29d0453289a4710b2cc07))

* Update tasks table ([`09dd021`](https://github.com/embeddings-benchmark/mteb/commit/09dd021527a1ba0a34f46f7f138faa94b8325939))

* Update tasks table ([`f4606dd`](https://github.com/embeddings-benchmark/mteb/commit/f4606dda9ff79b20e4388b1ffb1eae900384b07d))

* Update tasks table ([`2d5b194`](https://github.com/embeddings-benchmark/mteb/commit/2d5b1945933d93c26ba94a36c2339e61a869474a))

1.7.19

Fix

* fix: Added Kannada News Classification Dataset (492)

* Added Kannada News Classification Dataset
* made changes according to comments and added points
* Update mteb/tasks/Classification/kan/Kannada_News_Classification.py
* rename and use stratified_subsampling
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`e1b6c1c`](https://github.com/embeddings-benchmark/mteb/commit/e1b6c1c366add45edfea6e4de3aafcee44212d4b))

* fix: Added Hindi sentiment analysis dataset (491)

* Added Hindi sentiment analysis dataset
* Made changes based on comments and added points on points table
* linted correctly
* use stratified_subsampling
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`4ed19ce`](https://github.com/embeddings-benchmark/mteb/commit/4ed19ce4e48d01ef3f8b4d27f20c8b8a6fed45d9))

* fix: Add yelp review dataset (478)

* add yelp review dataset
* add results
* PR comments and update results
* add points
* use stratified_subsampling
* rerun with stratified
* fill in metadata from dataset/paper
---------
Co-authored-by: Isaac Chung <chungisaac1217gmail.com> ([`5458f2b`](https://github.com/embeddings-benchmark/mteb/commit/5458f2b81d5e0e15de32eaa9003ae07024339f33))

Unknown

* Update tasks table ([`95ab467`](https://github.com/embeddings-benchmark/mteb/commit/95ab467ed02263792dc98b68729243c53a1666e1))

* Update points table ([`dccd93d`](https://github.com/embeddings-benchmark/mteb/commit/dccd93d9d248bac312d5b1761bc58b01dfe4a482))

* Update tasks table ([`fdedf69`](https://github.com/embeddings-benchmark/mteb/commit/fdedf6970dc671c86210b1968a91f61c7bbb95a9))

* Update tasks table ([`7a8b323`](https://github.com/embeddings-benchmark/mteb/commit/7a8b3239c380faf566d290dda46191731d4520eb))

* Update tasks table ([`51bd5de`](https://github.com/embeddings-benchmark/mteb/commit/51bd5ded51d23b0faaab39e5902c3bf872dfc5b0))

* Update tasks table ([`0e3a7e2`](https://github.com/embeddings-benchmark/mteb/commit/0e3a7e2271354119739f17da0ebe723770162727))

* Update points table ([`691c448`](https://github.com/embeddings-benchmark/mteb/commit/691c44836822c48b815805f736449bd302502bec))

* Update tasks table ([`230844b`](https://github.com/embeddings-benchmark/mteb/commit/230844bce1eb926fa1be83bb972b9a6678678189))

* Update tasks table ([`d8b3931`](https://github.com/embeddings-benchmark/mteb/commit/d8b39313e2be866e93645ed2e8e8ae4b8be4480f))

* Update tasks table ([`f2393d4`](https://github.com/embeddings-benchmark/mteb/commit/f2393d4a7fd620170e60072f0295e657a8ca05a9))

* Update tasks table ([`f755386`](https://github.com/embeddings-benchmark/mteb/commit/f7553860667db26c749dc285deac19a581cc130f))

* Update tasks table ([`5080c48`](https://github.com/embeddings-benchmark/mteb/commit/5080c4818500d4c2eaa8273a82ee8bc401b6f6f6))

Page 44 of 58

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.