Flexeval

Latest version: v0.8.1

Safety actively analyzes 693883 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 6

0.7.4

What's Changed
* Change `OpenAIChatBatchAPI` returns empty string when request failed. by kevin3314 in https://github.com/sbintuitions/flexeval/pull/86


**Full Changelog**: https://github.com/sbintuitions/flexeval/compare/v0.7.3...v0.7.4

0.7.3

What's Changed
* Refactor variable name from is_corrects to evaluation_results' by kajyuuen in https://github.com/sbintuitions/flexeval/pull/81
* Add `template_path` arg to `Jinja2PromptTemplate` by ryokan0123 in https://github.com/sbintuitions/flexeval/pull/82
* Fix bug related to `category_key` in `LLMScore` and `ChatLLMScore` by junya-takayama in https://github.com/sbintuitions/flexeval/pull/85
* Change `OpenAIChatAPI` returns empty string when request failed. by kevin3314 in https://github.com/sbintuitions/flexeval/pull/84


**Full Changelog**: https://github.com/sbintuitions/flexeval/compare/v0.7.2...v0.7.3

0.7.2

What's Changed
* Update evaluate_reward_model's outputs by kajyuuen in https://github.com/sbintuitions/flexeval/pull/79
* Bump vllm from 0.5.3.post1 to 0.5.5 by dependabot in https://github.com/sbintuitions/flexeval/pull/72


**Full Changelog**: https://github.com/sbintuitions/flexeval/compare/v0.7.1...v0.7.2

0.7.1

What's Changed
* Fix import for reward modules by ryokan0123 in https://github.com/sbintuitions/flexeval/pull/73
* Use `ImmutableSandboxedEnvironment` to improve security by ryokan0123 in https://github.com/sbintuitions/flexeval/pull/74
* Implement `batch_compute_log_probs()` on `VLLM` class by junya-takayama in https://github.com/sbintuitions/flexeval/pull/75
* Set the default value of `disable_sliding_window` to `True` in `VLLM` class by junya-takayama in https://github.com/sbintuitions/flexeval/pull/76
* Fix flexeval_reward by kajyuuen in https://github.com/sbintuitions/flexeval/pull/78
* Check if temp file exists before close it in `OpenAIChatBatchAPI` by ryokan0123 in https://github.com/sbintuitions/flexeval/pull/77


**Full Changelog**: https://github.com/sbintuitions/flexeval/compare/v0.7.0...v0.7.1

0.7.0

Not secure
What's Changed
* Support reward model evaluation by kajyuuen in https://github.com/sbintuitions/flexeval/pull/69


**Full Changelog**: https://github.com/sbintuitions/flexeval/compare/v0.6.6...v0.7.0

0.6.6

Not secure
What's Changed
* Fix typing of `keep_conditions` and `remove_conditions` by ryokan0123 in https://github.com/sbintuitions/flexeval/pull/70
* Add `data_range` to datasets by ryokan0123 in https://github.com/sbintuitions/flexeval/pull/71


**Full Changelog**: https://github.com/sbintuitions/flexeval/compare/v0.6.5...v0.6.6

Page 2 of 6

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.