Latest version: v0.1.8
The information on this page was curated by experts in our Cybersecurity Intelligence Team.
A general x-bit quantization engine for LLMs,[2-8] bits, awq/gptq/hqq
No known vulnerabilities found
Has known vulnerabilities