Benchmark-llm-serving

Latest version: v1.0.3

Safety actively analyzes 682229 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

1.0.3

**Improvements**

PR 5 : Add support for mistral backend
PR 5 : Added compatibility with vLLM 0.5.3.post1

1.0.2

**Improvements**:

PR 1 : Readmes are now automatically generated when launching the bench_suite and less useful data are compressed (zip format)

**Project**:
PR 2 : git-lfs has been removed from the repo

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.