The AdamR optimizer which tends to maintain the parameters from pre-training.
TODOs
- [x] a basic AdamR optimzer, just like other PyTorch optimizers - [ ] refine the documentations - [x] provide a function to specify initial parameters
0.0.1
Insight
The AdamR optimizer which tends to maintain the parameters from pre-training.
TODOs
- [x] a basic AdamR optimzer, just like other PyTorch optimizers - [ ] refine the documentations - [ ] provide a function to specify initial parameters