Evaluate

What's Changed
* Update the documentation and citation of mauve by krishnap25 in https://github.com/huggingface/evaluate/pull/416
* Remove unused dependency by daskol in https://github.com/huggingface/evaluate/pull/507
* Add confusion matrix by osanseviero in https://github.com/huggingface/evaluate/pull/528
* Update python to 3.8 by qubvel in https://github.com/huggingface/evaluate/pull/571
* Fix FileFreeLock by lhoestq in https://github.com/huggingface/evaluate/pull/578
* Fix example doc in load function by alexrs in https://github.com/huggingface/evaluate/pull/575
* Speeding up mean_iou metric computation by qubvel in https://github.com/huggingface/evaluate/pull/569

New Contributors
* rtrompier made their first contribution in https://github.com/huggingface/evaluate/pull/510
* daskol made their first contribution in https://github.com/huggingface/evaluate/pull/507
* qubvel made their first contribution in https://github.com/huggingface/evaluate/pull/571
* alexrs made their first contribution in https://github.com/huggingface/evaluate/pull/575

**Full Changelog**: https://github.com/huggingface/evaluate/compare/v0.4.1...v0.4.2

New Contributors
* cakiki made their first contribution in https://github.com/huggingface/evaluate/pull/403
* hazrulakmal made their first contribution in https://github.com/huggingface/evaluate/pull/386
* kdutia made their first contribution in https://github.com/huggingface/evaluate/pull/411
* tupini07 made their first contribution in https://github.com/huggingface/evaluate/pull/417
* jorahn made their first contribution in https://github.com/huggingface/evaluate/pull/418
* Plutone11011 made their first contribution in https://github.com/huggingface/evaluate/pull/405
* TKaanKoc made their first contribution in https://github.com/huggingface/evaluate/pull/407
* mariosasko made their first contribution in https://github.com/huggingface/evaluate/pull/463
* Wauplin made their first contribution in https://github.com/huggingface/evaluate/pull/467
* ricardorei made their first contribution in https://github.com/huggingface/evaluate/pull/443
* bzz made their first contribution in https://github.com/huggingface/evaluate/pull/498
* lhoestq made their first contribution in https://github.com/huggingface/evaluate/pull/505

**Full Changelog**: https://github.com/huggingface/evaluate/compare/v0.4.0...v0.4.1

What's Changed
* add trainer integration docs by lvwerra in https://github.com/huggingface/evaluate/pull/325
* Stop using model-defined truncation in perplexity calculation by mathemakitten in https://github.com/huggingface/evaluate/pull/333
* Don't use eval for Evaluator instances in the doc by fxmarty in https://github.com/huggingface/evaluate/pull/341
* fix caching by lvwerra in https://github.com/huggingface/evaluate/pull/336
* Fix 327 set default row of gradio webui to 1 and drop empty/blank row by Raibows in https://github.com/huggingface/evaluate/pull/335
* Update pr docs actions by mishig25 in https://github.com/huggingface/evaluate/pull/344
* Fix `scikit-learn` install in spaces by lvwerra in https://github.com/huggingface/evaluate/pull/345
* added MASE, sMAPE and MAPE metrics by kashif in https://github.com/huggingface/evaluate/pull/330
* fix sklearn dependency in mape, mase and smape by lvwerra in https://github.com/huggingface/evaluate/pull/346
* Update link text by stevhliu in https://github.com/huggingface/evaluate/pull/360
* Corrected range of MAE by clefourrier in https://github.com/huggingface/evaluate/pull/359
* Revert "Update pr docs actions" by mishig25 in https://github.com/huggingface/evaluate/pull/363
* Evaluation suite by mathemakitten in https://github.com/huggingface/evaluate/pull/337
* Matthews correlation coefficient by sanderland in https://github.com/huggingface/evaluate/pull/362
* fix tf version by lvwerra in https://github.com/huggingface/evaluate/pull/372
* Add TextGeneration Evaluator by NimaBoscarino in https://github.com/huggingface/evaluate/pull/350
* Fix typo in rouge types by davebulaval in https://github.com/huggingface/evaluate/pull/364
* Add `Evaluate` usage for `scikit-learn` by awinml in https://github.com/huggingface/evaluate/pull/368
* Adding metric visualization by sashavor in https://github.com/huggingface/evaluate/pull/342
* Add NIST metric by BramVanroy in https://github.com/huggingface/evaluate/pull/250
* add GitHub Actions CI by lvwerra in https://github.com/huggingface/evaluate/pull/375
* Add Evaluate Usage for Keras and Tensorflow by arjunpatel7 in https://github.com/huggingface/evaluate/pull/370
* fix version by lvwerra in https://github.com/huggingface/evaluate/pull/380
* CharacTER: MT metric by BramVanroy in https://github.com/huggingface/evaluate/pull/286
* CharCut: another character-based MT evaluation metric by BramVanroy in https://github.com/huggingface/evaluate/pull/290
* asr model evaluator addition + doc by bayartsogt-ya in https://github.com/huggingface/evaluate/pull/378
* Docs for EvaluationSuite by mathemakitten in https://github.com/huggingface/evaluate/pull/340
* Update the documentation of Mauve by krishnap25 in https://github.com/huggingface/evaluate/pull/377
* fix-ci-badge by lvwerra in https://github.com/huggingface/evaluate/pull/385

New Contributors
* Raibows made their first contribution in https://github.com/huggingface/evaluate/pull/335
* kashif made their first contribution in https://github.com/huggingface/evaluate/pull/330
* clefourrier made their first contribution in https://github.com/huggingface/evaluate/pull/359
* davebulaval made their first contribution in https://github.com/huggingface/evaluate/pull/364
* awinml made their first contribution in https://github.com/huggingface/evaluate/pull/368
* arjunpatel7 made their first contribution in https://github.com/huggingface/evaluate/pull/370
* bayartsogt-ya made their first contribution in https://github.com/huggingface/evaluate/pull/378
* krishnap25 made their first contribution in https://github.com/huggingface/evaluate/pull/377

**Full Changelog**: https://github.com/huggingface/evaluate/compare/v0.3.0...v0.4.0

What's Changed
* add multilabel f1 eval usage by fcakyon in https://github.com/huggingface/evaluate/pull/221
* Force get_supported_tasks() to return a list instead of dict keys by mathemakitten in https://github.com/huggingface/evaluate/pull/227
* Unpin rouge_score by albertvillanova in https://github.com/huggingface/evaluate/pull/220
* Remove import statement in Measurement Card by meg-huggingface in https://github.com/huggingface/evaluate/pull/231
* make rouge support multi-ref by lvwerra in https://github.com/huggingface/evaluate/pull/229
* Fix enforce string by lvwerra in https://github.com/huggingface/evaluate/pull/230
* Fix examples in perplexity measurement docs by mathemakitten in https://github.com/huggingface/evaluate/pull/238
* Add Wilcoxon's signed rank test by douwekiela in https://github.com/huggingface/evaluate/pull/237
* Add support for two input columns for TextClassificationEvaluator by fxmarty in https://github.com/huggingface/evaluate/pull/205
* fix bug in TEMPLATE_REQUIRE: add comma by BramVanroy in https://github.com/huggingface/evaluate/pull/248
* Minor quicktour doc suggestions by stevhliu in https://github.com/huggingface/evaluate/pull/236
* Clarify error message for ChrF no. references by BramVanroy in https://github.com/huggingface/evaluate/pull/247
* only track unique missing dependencies by BramVanroy in https://github.com/huggingface/evaluate/pull/246
* Update evaluate in spaces by lvwerra in https://github.com/huggingface/evaluate/pull/228
* add `commit_hash` to args by lvwerra in https://github.com/huggingface/evaluate/pull/253
* Change perplexity to be calculated with base e by mathemakitten in https://github.com/huggingface/evaluate/pull/242
* Rebase for previous PR by mathemakitten in https://github.com/huggingface/evaluate/pull/254
* Fix docstrings with new perplexities with base e by mathemakitten in https://github.com/huggingface/evaluate/pull/255
* add a tokenizer option to rouge by lvwerra in https://github.com/huggingface/evaluate/pull/258
* Adding list_duplicates=True to example. by meg-huggingface in https://github.com/huggingface/evaluate/pull/263
* Minor change in describing what this does. by meg-huggingface in https://github.com/huggingface/evaluate/pull/267
* Mapping example output to returned output. by meg-huggingface in https://github.com/huggingface/evaluate/pull/268
* Changes "duplicates_list" to "duplicates_dict" (since it's dict) by meg-huggingface in https://github.com/huggingface/evaluate/pull/265
* Changes "duplicates_list" to "duplicates_dict" in the example. by meg-huggingface in https://github.com/huggingface/evaluate/pull/264
* Add slow flag to two column parity test by lvwerra in https://github.com/huggingface/evaluate/pull/273
* Remove `handle_impossible_answer` from the default `PIPELINE_KWARGS` in the question answering evaluator by fxmarty in https://github.com/huggingface/evaluate/pull/272
* Toxicity Measurement by sashavor in https://github.com/huggingface/evaluate/pull/262
* Automatically choose dataset split if none provided by mathemakitten in https://github.com/huggingface/evaluate/pull/232
* Fix YAML in Toxicity by lvwerra in https://github.com/huggingface/evaluate/pull/278
* Added metric Brier Score by kadirnar in https://github.com/huggingface/evaluate/pull/275
* Check for mismatch in device setup in evaluator by mathemakitten in https://github.com/huggingface/evaluate/pull/287
* Fix transfomers import in the evaluator by mathemakitten in https://github.com/huggingface/evaluate/pull/291
* Add support for name field when loading data by mathemakitten in https://github.com/huggingface/evaluate/pull/283
* Adding regard measurement by sashavor in https://github.com/huggingface/evaluate/pull/271
* Raise exception instead of assert in BertScore by BramVanroy in https://github.com/huggingface/evaluate/pull/292
* fix regard yaml by lvwerra in https://github.com/huggingface/evaluate/pull/295
* Add CONTRIBUTING.md by mathemakitten in https://github.com/huggingface/evaluate/pull/293
* Refactor kwargs and configs by lvwerra in https://github.com/huggingface/evaluate/pull/188
* Revert "Refactor kwargs and configs" by lvwerra in https://github.com/huggingface/evaluate/pull/299
* Add missing `split` and `subset` kwarg into other evaluators by mathemakitten in https://github.com/huggingface/evaluate/pull/301
* Adding HONEST score by sashavor in https://github.com/huggingface/evaluate/pull/279
* fix wrong sorting in check by sanderland in https://github.com/huggingface/evaluate/pull/305
* Fix HONEST yaml by lvwerra in https://github.com/huggingface/evaluate/pull/303
* Refactor current_features to selected_feature_format by mathemakitten in https://github.com/huggingface/evaluate/pull/306
* replace datasets list with local list of tasks by lvwerra in https://github.com/huggingface/evaluate/pull/309
* Adding torch to the requirements by sashavor in https://github.com/huggingface/evaluate/pull/311
* Honest space fix by sashavor in https://github.com/huggingface/evaluate/pull/312
* Use HTML relative paths for tiles by lewtun in https://github.com/huggingface/evaluate/pull/318
* Test for valid YAML files by mathemakitten in https://github.com/huggingface/evaluate/pull/308
* add versioning the `HubEvaluationModuleFactory` by lvwerra in https://github.com/huggingface/evaluate/pull/314
* Add text2text evaluator by lvwerra in https://github.com/huggingface/evaluate/pull/261
* try main if tag does not work by lvwerra in https://github.com/huggingface/evaluate/pull/322

New Contributors
* fcakyon made their first contribution in https://github.com/huggingface/evaluate/pull/221
* meg-huggingface made their first contribution in https://github.com/huggingface/evaluate/pull/231
* stevhliu made their first contribution in https://github.com/huggingface/evaluate/pull/236
* kadirnar made their first contribution in https://github.com/huggingface/evaluate/pull/275
* sanderland made their first contribution in https://github.com/huggingface/evaluate/pull/305

**Full Changelog**: https://github.com/huggingface/evaluate/compare/v0.2.2...v0.3.0

What's Changed
* Update CLI docs by lvwerra in https://github.com/huggingface/evaluate/pull/218
* Add a fingerprint for each EvaluationModule by mathemakitten in https://github.com/huggingface/evaluate/pull/206
* Fix loading error by lvwerra in https://github.com/huggingface/evaluate/pull/222


**Full Changelog**: https://github.com/huggingface/evaluate/compare/v0.2.1...v0.2.2

What's Changed
* Add measurements to quality and style checks by lvwerra in https://github.com/huggingface/evaluate/pull/203
* Add comparisons and measurements to code quality tests by lvwerra in https://github.com/huggingface/evaluate/pull/204
* Remove mention to datasets from docs by albertvillanova in https://github.com/huggingface/evaluate/pull/207
* Adding label distribution measurement by sashavor in https://github.com/huggingface/evaluate/pull/202
* Fix spaces tagging by lvwerra in https://github.com/huggingface/evaluate/pull/217
* set datasets to >=2.0.0 by lvwerra in https://github.com/huggingface/evaluate/pull/216


**Full Changelog**: https://github.com/huggingface/evaluate/compare/v0.2.0...v0.2.1