The following architectures can be trained on [AWS Trainium instances](https://aws.amazon.com/fr/ec2/instance-types/trn1/) (trn1.2xlarge and trn1.32xlarge) :
- ALBERT
- BERT
- DistilBERT
- RoBERTa
- XLM-RoBERTa
- CamemBERT
- Electra
- GPT-2
- GPT-Neo
- MarianMT
- T5
- BART
- ViT
Training examples for many tasks are provided [here](https://github.com/huggingface/optimum-neuron/tree/v0.0.1-release/examples).