What's Changed * Deprecating the CLI by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/6 * Improved workflow to cache hatch's virtual environment by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/10 * Minimum python version now 3.9 by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/12 * Filter relation files to only include files with correct suffix/extension by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/13 * Scoring refactoring by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/7 * Improving `get_metrics` by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/9 * Improved workflows by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/15 * Documentation improvements by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/16
What's Changed * Making instance indices in instance table contiguous after filtering for a subset by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/2 * Enabling the use of additional data file formats by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/1 * Additional result features by plonerma in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/4 * Trainer callback by oneSebastian in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/5
New Contributors * oneSebastian made their first contribution in https://github.com/lm-pub-quiz/lm-pub-quiz/pull/5
With the acceptance of our paper at NAACL, we publish our evaluation library LM Pub Quiz to the community. Read the [pre-print of our paper](https://arxiv.org/abs/2404.04113) or visit our [overview website](https://lm-pub-quiz.github.io/) to find out more.