Languagemodels

Changed

- Add new separators to document chunking heuristic

Fixed

- Allow missing query prefixes for embedding models

Added

- Support Phi-3-mini-4k-instruct
- Support GIST-small-Embedding-v0 embedding model
- Store model runtime stats to improve benchmarking and analysis

Added

- Support Meta-Llama-3-8B-Instruct
- Support gemma-2b-it
- Support h2o-danube2-1.8b-chat
- Support WizardLM-2-7B

Fixed

- Correct issue causing `choices` to be scored improperly

Added

- CUDA 12 support

Fixed

- Run embedding models on CPU to work around memory copy issue

Changed

- Improve embedding search performance

Added

- Add openchat-3.5-0106 model
- Add h2o-danube-1.8b-chat model