Languagemodels

Changed

- Attempt to chunk context on semantic boundaries

Added

- Allow filtering by model license

Fixed

- Update classification to only allow valid classes to be returned

Changed

- Disable beam search for faster inference

Changed

- Normalize output
- Rename some functions

Added

- Support xl models

Changed

- Less verbose chat syntax

Changed

- Use ctranslate2 for greater efficiency

- Original version using HuggingFace Transformers