Added several new layers:
- LayerNorm
- MultiheadAttention
- ConvTranspose, ConvTranspose1d, ConvTranspose2d, ConvTranspose3d
- Embedding
(Thanks to andyehrenberg for implementing much of this, and to lucidrains for reviewing the implementation of attention.)
Autogenerated release notes as follows:
What's Changed
* ConvTranspose layers, MultiheadAttention, lookup embeddings, LayerNorm by andyehrenberg in https://github.com/patrick-kidger/equinox/pull/34
* Tidied; simplified; generalised ConvTranspose implementation. by patrick-kidger in https://github.com/patrick-kidger/equinox/pull/40
* Attention, Transposed Convolutions, Embeddings, LayerNorm by patrick-kidger in https://github.com/patrick-kidger/equinox/pull/38
**Full Changelog**: https://github.com/patrick-kidger/equinox/compare/v0.2.1...v0.2.2