* fix: Fixed definition of zero-shot in ModelMeta (1747)
* Corrected zero_shot definition to be based on task names, not dataset path ([`407e205`](https://github.com/embeddings-benchmark/mteb/commit/407e20541613018b61fda2f1ec6be0ef9741e194))
1.28.2
Fix
* fix: Fixed task_type aggregation on leaderboard (1746)
* Fixed task_type aggregation in leaderboard
* Fixed an error due to unneccesary indentation in get_score ([`76bb070`](https://github.com/embeddings-benchmark/mteb/commit/76bb070f5966716010e399c6bf1c2278ce83a173))
1.28.1
Fix
* fix: Leaderboard Speedup (1745)
* Added get_scores_fast
* Made leaderboard faster with smarter dependency graph and event management and caching
* Changed print to logger.info ([`9eff8ca`](https://github.com/embeddings-benchmark/mteb/commit/9eff8cae60e3fcf9346969dfbf7f548f3e27bc55))
Test
* test: Add script to test model loading below n_parameters threshold (1698)
* add model loading test for models below 2B params * add failure message to include model namne * use the real get_model_meta * use cache folder * teardown per function * fix directory removal * write to file * wip loading from before * wip * Rename model_loading_testing.py to model_loading.py * Delete tests/test_models/test_model_loading.py * checks for models below 2B * try not using cache folder * update script with scan_cache_dir and add args * add github CI: detect changed model files and run model loading test * install all model dependencies * dependecy installations and move file location * should trigger a model load test in CI * find correct commit for diff * explicity fetch base branch * add make command * try to run in python instead and add pytest * fix attribute error and add read mode * separate script calling * let pip install be cached and specify repo path * check ancestry * add cache and rebase * try to merge instead of rebase * try without merge base * check if file exists first * Apply suggestions from code review Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> * Update .github/workflows/model_loading.yml Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> * address review comments to run test once from CI and not pytest --------- Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsengmail.com> ([`8d033f3`](https://github.com/embeddings-benchmark/mteb/commit/8d033f39415cd00840a1e0f6305d453ca6032abf))
Unknown
* Fixed result loading on leaderboard (1739)
* Only main_score gets loaded for leaderboard thereby avoiding OOM errors
* Fixed plot failing because of missing embedding dimensions
* Ran linting ([`752d2b8`](https://github.com/embeddings-benchmark/mteb/commit/752d2b8013db501af11db851dd07a70931b266b0))