Latest version: v0.6.3.0
The information on this page was curated by experts in our Cybersecurity Intelligence Team.
A high-throughput and memory-efficient inference and serving engine for LLMs
No known vulnerabilities found
Has known vulnerabilities