Friendli-model-optimizer

Latest version: v0.8.0

Safety actively analyzes 688554 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.8.0

- Support ExaoneForCausalLM
- Fix CohereForCausalLM with better quantization logic.

0.7.0

- Further optimization for running FP8, and INT8 quantization.
- Support searching automatic calibration dataset batch size for running FMO.
- Support [AWQ(Activation-aware Weight Quantization)].

0.5.1

0.5.0

0.3.0

**Full Changelog**: https://github.com/friendliai/friendli-model-optimizer/compare/v0.2.1...v0.3.0

0.2.1

**Full Changelog**: https://github.com/friendliai/friendli-model-optimizer/compare/v0.2.0...v0.2.1

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.