Langport

Latest version: v0.3.11

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 3

What's Changed
===
* Support model Qwen
* Inference speedup
* Dynamic Batch Inference
* Gateway logging

What's Changed
===
* Support 4bit quantization
* Support InternLM and Llama2
* Faster 8bit inference

What's Changed
- Support generation logprobs parameter.
- Add chunk size and threads args for ggml worker
- Support NingYu

What's Changed
===
* optimum inference support
* chatglm inference bug fix

What's Changed
==
* ggml: concurrency lock
* openai gateway: redirect model name

What's Changed
===
* ggml support (not only llama models).
* use ctransformers instead of llama.cpp.

Has known vulnerabilities

Previous Next