Llama-cpp-http

Latest version: v0.3.3

Safety actively analyzes 683530 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 4 of 4

0.1.1

Added:
- Homepage URL.
- Repository URL.

Removed:
- Removed `pyopencl` package from requirements.

0.1.0

Added:
- HTTP Server based on `aiohttp`, and deployed using `gunicorn`.
- HTTP Client for LangChain based on `websockets` for sync calls.
- `pyopencl` is used to determin available **OpenCL** devices (GPUs).
- Instructions in `LLAMA_CPP.md` how to build [llama.cpp](https://github.com/ggerganov/llama.cpp) w/o accelaration.
- Cahcing using `PonyORM` and `sqlite3`.

Page 4 of 4

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.