Ktransformers

Latest version: v0.1.2

Safety actively analyzes 687959 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

8.08.68.78.9

3. test and support python 3.10
4. add a dockerfile to build docker image
5. update README.md to support docker (In Progress: upload docker image)

0.1.2

1. Support windows native. 4
2. Support multiple GPU. 8
3. Support llamfile as linear backend.
4. Support new model: mixtral 8*7B and 8*22B
5. Support q2k, q3k, q5k dequant on gpu. 16
6. Support github action to create pre compile package
7. Support shared memory in different operator
8. Fix some bugs on build from source 23

0.1.1

0.1.0

1. Complete the submission information for PyPI.
2. Support for dynamically detecting the current environment of the client. If precompiled packages can be used for installation, download and install the precompiled packages. (Adapted from flash-attn)
3. Modified the installation process in the README.

Links

Releases

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.