Simpletransformers

Added

- Bug fixed in LanguageModelingModel which could occur when loading a GPU trained model on CPU. [alvaroabascar](https://github.com/alvaroabascar)
- Bug fixed in NER ONNX for models with token type ids. [whr778](https://github.com/whr778)
- Bug fixed in NER lazy loading. [mhdhdri](https://github.com/mhdhdri)
- Bug fixed in sliding window tie breaking [calebchiam](https://github.com/calebchiam)

Changed

- Thread count no longer fixed when using ONNX [rayline](https://github.com/rayline)

Changed

- W&B run id is now assigned as a model attribute

Added

- Pretraining and finetuning BigBird and XLMRoBERTa LMs [whr778](https://github.com/whr778)

Added

- Added class weights support for NER [tiena2cva](https://github.com/tiena2cva)
- Added Herbert [Zhylkaaa](https://github.com/Zhylkaaa)

Fixed

- Bug fixes

Fixed

- Updated W&B repo label

Fixed

- Reverted changes to W&B repo label which weren't working.