Xllm

Latest version: v0.1.8

Safety actively analyzes 688463 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

0.1.8

What's Changed
* DeepSpeed on single GPU by BobaZooba in https://github.com/BobaZooba/xllm/pull/8
* Add project_name by BobaZooba in https://github.com/BobaZooba/xllm/pull/11
* set transformers version by BobaZooba in https://github.com/BobaZooba/xllm/pull/12
* Download model without loading to RAM by BobaZooba in https://github.com/BobaZooba/xllm/pull/13


**Full Changelog**: https://github.com/BobaZooba/xllm/compare/0.1.7...0.1.8

0.1.7

What's Changed
* Tokenizer trust remote code by BobaZooba in https://github.com/BobaZooba/xllm/pull/2

0.1.2

What's Changed
* Int8 fusing by BobaZooba in https://github.com/BobaZooba/xllm/pull/1

**Full Changelog**: https://github.com/BobaZooba/xllm/compare/0.1.1...0.1.2

0.1.0

🎉 Code and documents done!

Useful materials

- [Quickstart](https://github.com/KompleteAI/xllm/tree/docs-v1#quickstart-): basics of `xllm`
- [Examples](https://github.com/BobaZooba/xllm/examples): minimal examples of using `xllm`
- [Guide](https://github.com/BobaZooba/xllm/blob/main/GUIDE.md): here, we go into detail about everything the library can
do
- [Demo project](https://github.com/BobaZooba/xllm-demo): here's a minimal step-by-step example of how to use X—LLM and fit it
into your own project
- [WeatherGPT](https://github.com/BobaZooba/wgpt): this repository features an example of how to utilize the xllm library. Included is a solution for a common type of assessment given to LLM engineers, who typically earn between $120,000 to $140,000 annually
- [Shurale](https://github.com/BobaZooba/shurale): project with the finetuned 7B Mistal model

0.0.5

Code done and tested. Time to docs

Links

Releases

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.