Safety vulnerability ID: 61866
The information on this page was manually curated by our Cybersecurity Intelligence Team.
Vllm 0.2.1 includes a security fix: Vulnerable memory modification to GPU shared memory. …
[This advisory has been limited. Please create a free account to view the full advisory.]
Latest version: 0.6.4.post1
A high-throughput and memory-efficient inference and serving engine for LLMs
Major Changes * PagedAttention V2 kernel: Up to 20% end-to-end latency reduction * Suppo…
[This text has been limited. Please create a free account to view the full text.]