Optimum

Latest version: v1.23.3

Safety actively analyzes 687918 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 21 of 22

0.0.12

New features

- quanto kernels library (not used for now in quantize).

Breaking changes

- quantization types are now all quanto.dtype

0.0.11

New features:

- support int2 and int4 weights.

New contributors:

younesbelkada
a-r-r-o-w

0.0.10

New features:

- calibration streamline option to remove spurious quantize/dequantize,
- calibration debug mode.

0.0.9

New features:

- quantize weights and activations parameters
- float8 activations

0.0.8

New features:

- weight-only quantization,
- integer matmul acceleration on CUDA.

Bug fixes:

- actually use float16 weights,
- avoid float16 overflows,
- correct device placement,
- robust serialization.

0.0.7

New features:

- per-axis quantization

Page 21 of 22

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.