Quanto

Latest version: v0.2.0

Safety actively analyzes 638452 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 3

0.0.9

New features:

- quantize weights and activations parameters
- float8 activations

0.0.8

New features:

- weight-only quantization,
- integer matmul acceleration on CUDA.

Bug fixes:

- actually use float16 weights,
- avoid float16 overflows,
- correct device placement,
- robust serialization.

0.0.7

New features:

- per-axis quantization

0.0.6

New features:

- support `opt` models,
- support `gpt-neox` models,
- support `codegen` models.

0.0.5

New features:

- support MPS devices,
- support Transformer models

0.0.4

Fix release to add correct package metadata.

Page 2 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.