Added
- Initial support for a classical GPTQ model using the MPQLinear layer
- AutoGPTQ information and commands in the repository
- Support for LoRA and GPTQ evaluation
- SFT comparison updates
- Missing comment to the customized trainer class
Fixed
- Issue in GbaSFTTrainer for saving non-GBA models
- Mismatch issue between GPTQ and LoRA
- Bug preventing quant_strategy.json from being saved during SFT
Updated
- README with new AutoGPTQ and GPTQ support information