Llm-rs

AutoModel` compatible models will now use the official `tokenizers` library, which improves the decoding accuracy, especially for all non llama based models.

If you want to specify a tokenizer manually, it can be set via the `tokenizer_path_or_repo_id` parameter. If you want to use the default GGML tokenizer the huggingface support can be disabled via `use_hf_tokenizer`.

Added support for `q5_0`,`q5_1` and `q8_0` formats.

Added the `stream` method to each model, which returns a generator that can be consumed to generate a response.

⚠️ The GGML quantization format was updated again, old models will be incompatible ⚠️

AutoModel` can now automatically download GGML converted models and normal Transformer models from the Huggingface Hub.