Internal changes:
- The DataLoader is not part of the generator anymore
- Full backward hooks in jacobian generator
- Migrates gradient computation outside of Jacobian class to JacobianFactory
- Adds efficient grads for convolution implementation, with switch to choose between 2 implementations
- Changes solve implementation
New features
- PVector add_to_model method
- Matrix-matrix products for KFAC, Dense, BlockDiag; Diag representations
- Solve for PMatLowRank
- Dot between 2 PVector objects
- Pickle for PMat and PVector objects
- Grad method for PVector objects
- MC Fisher helper for segmentation
- Adds get_kfe method to PMatEKFAC
New layers
- Custom layers: Cosine, Weightnorm, Affine
- Support for additional layers: ConvTranspose2d