Latest version: v0.2.2.1
The information on this page was curated by experts in our Cybersecurity Intelligence Team.
A general x-bit quantization engine for LLMs,[2-8] bits, awq/gptq/hqq/vptq
No known vulnerabilities found
Has known vulnerabilities