- Neural network enhancement by changing the input to the PCA space and switching to RMSNorm.
- Gaussian Mixture and consensus K-Means initialization
- Improved OOM data handling
- Multi-GPU training and inference
**Note**: these releases introduce breaking changes which might make models trained on prior versions not to work as expected. Please use a version previous to `1.5.0` if that's the case.
**Full Changelog**: https://github.com/AI-sandbox/neural-admixture/compare/v1.4.1...v1.5.0