Llmlingua

Latest version: v0.2.2

The latest version of llmlingua with no known security vulnerabilities is 0.2.2. We recommend installing version 0.2.2.

The information on this page was curated by experts in our Cybersecurity Intelligence Team.

Latest release: v0.2.2 at April 9, 2024
License: MIT (MIT License)

Description

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Resources

GitHub
PyPi

Vulnerabilities

See all vulnerabilities

No known vulnerabilities found

Versions (14)

See all versions

Has known vulnerabilities

0.2.2
0.2.1
0.2.0
0.1.6
0.1.5
0.1.3
0.1.2
0.1.1
0.1.1.dev5
0.1.1.dev4
0.1.1.dev3
0.1.1.dev2
0.1.1.dev1
0.1.1.dev0