This is the first big release of this project and it implements all three forward passes as closely as I could follow the paper: https://arxiv.org/pdf/2307.08621.pdf
There may be some bugs here and there, but this should be very close until Microsoft releases their codebase.
What's Changed
* Pulling in workflows prematurely by zbloss in https://github.com/zbloss/RetentiveNetwork/pull/2
* Fixed pipelines by zbloss in https://github.com/zbloss/RetentiveNetwork/pull/3
* use poetry to publish package by zbloss in https://github.com/zbloss/RetentiveNetwork/pull/4
* V0.1.0 tests by zbloss in https://github.com/zbloss/RetentiveNetwork/pull/5
* Adds chunkwise forward pass by zbloss in https://github.com/zbloss/RetentiveNetwork/pull/6
**Full Changelog**: https://github.com/zbloss/RetentiveNetwork/compare/v0.0.1...v0.1.0