Chembench

Features
- Added support for multimodal models (748)
- Make API consistent by relying on `LiteLLM` messages (657, 633)
- Made it possible to customize system prompts (745)
- Implemented automatic retries in case of refusals (747)
- Implemented batch inference for local models (658)

Docs
- Reworked docs to include how-to guides

Features
- Reworked the question corpus (deleted some (semi)-automatically generated questions, added new ones)
- Updated classification into topics and human subset (https://github.com/lamalab-org/chem-bench/pull/478)
- Allow setting permutation from `Prompter` class (https://github.com/lamalab-org/chem-bench/pull/443)
- Track if LLM extraction was called (https://github.com/lamalab-org/chem-bench/pull/435)
- Added tags for reasoning and knowledge (https://github.com/lamalab-org/chem-bench/pull/412)
- Detect if LLM refused to answer (https://github.com/lamalab-org/chem-bench/pull/440)

Chore
- Simplified package setup by moving to `pyproject.toml` (https://github.com/lamalab-org/chem-bench/pull/465)

Initial release of the project.
The project is still under development and may have breaking changes in the future.