Continuous-eval

Latest version: v0.3.7

Safety actively analyzes 623075 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

0.3.7

What's Changed
* fixed double counting corner case for precision / average precision in https://github.com/relari-ai/continuous-eval/pull/55
* Fix required keyword for code string to ground_truth_answers in https://github.com/relari-ai/continuous-eval/pull/56

New Contributors
* stantonius made their first contribution in https://github.com/relari-ai/continuous-eval/pull/56

**Full Changelog**: https://github.com/relari-ai/continuous-eval/compare/v0.3.5...v0.3.7

0.3.5

- Add bedrock LLM provider
- Bug fixing

0.3.4

What's Changed
* Add cohere LLM in https://github.com/relari-ai/continuous-eval/pull/46
* Feature/llm custom metric in https://github.com/relari-ai/continuous-eval/pull/48
* Feature: add `vllm` openai api endpoint in https://github.com/relari-ai/continuous-eval/pull/49

New Contributors
* joennlae made their first contribution in https://github.com/relari-ai/continuous-eval/pull/49

**Full Changelog**: https://github.com/relari-ai/continuous-eval/compare/v0.3.2...v0.3.4

0.3.2

- Metrics batch execution now use threads by default
- Bug fixing

0.3.1

Key points:

- Added `from_data` class method to `Dataset` class
- Fixed `is_empty` method in EvaluationResults, MetricsResults, and TestResults
- Added error handling in LLM-based metrics

0.2.7

What's Changed
* Added Code Evaluation Metrics in https://github.com/relari-ai/continuous-eval/pull/29


**Full Changelog**: https://github.com/relari-ai/continuous-eval/compare/v0.2.6...v0.2.7

Links

Releases

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.