Mistralrs

What's Changed
* Add an example by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/357
* Fix no auth token for local loading by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/360
* fix: Ensure committed files are normalized to LF by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/361
* Fix unauth check by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/362
* Allow default unigram unk token for GGUF by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/363
* Disable cublaslt if using f16 kernels by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/359
* refactor: GGUF + GGML Loaders with `ModelKind` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/356
* Clamp n device layers to n model layers by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/367
* Bump version to 0.1.12 by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/368


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.11...v0.1.12

What's Changed
* refactor: `ModelKind` with `strum` + `derive_more` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/335
* Update dependencies by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/343
* Set device to cpu if loading isq by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/346
* Expose some APIs on the Rust side by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/348
* Propogating Regex init error by gregszumel in https://github.com/EricLBuehler/mistral.rs/pull/349
* Add a verbose mode by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/353
* Refactor `deserialize_chat_template` by Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/354
* Add support for using GGUF tokenizer by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/345

New Contributors
* gregszumel made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/349

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.10...v0.1.11

What's Changed
* Fixes and verbosity improvements for device mapping by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/332
* chore: `SimpleModelPaths` should be renamed to `LocalModelPaths` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/331
* Remove candle-layer-norm dep by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/333
* Refactor layers.rs by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/338
* chore: Simplify `utils/token.rs:get_token()` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/328
* chore: Use `strum` to simplify `GGUFArchitecture` maintenance by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/334
* Fix mistral model repeat kv by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/340

New Contributors
* polarathene made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/331

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.9...v0.1.10

What's Changed
* Improve chat templates docs by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/327
* Use cuBLASlt in attention by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/325


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.8...v0.1.9

Overview
- Documentation improvements
- Better handling of CTRL-C in interactive mode
- Matmul via low-precision kernels to take advantage of faster cuBLAS GEMM kernels (thanks lucasavila00)
- New loading API (thanks Jeadie)
- Various small bug fixes
- Reduce dependancy complexity (thanks LLukas22)

What's Changed
* bug fix: llama kv cache part by keisuke-niimi-insightedge-jp in https://github.com/EricLBuehler/mistral.rs/pull/300
* Refactor cache manager and kv cache by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/304
* Update the docs for ISQ and misc by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/310
* Make `pyo3` an optional dependency in `mistralrs-core` by LLukas22 in https://github.com/EricLBuehler/mistral.rs/pull/303
* Update kv cache by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/312
* Print gguf metadata consistently by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/313
* Allow loading LoRA without activating adapters and fix bugs by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/306
* Remove spurious tokenizer warnings by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/314
* Better handling of ctrlc by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/315
* Add analysis bot by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/316
* Quantized: Use cublas for prompt by lucasavila00 in https://github.com/EricLBuehler/mistral.rs/pull/238
* Support loading model into pipeline from local filesystem by Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/308
* Fix the ctrlc handler by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/318
* Don't force QLlama to have >2 input dims Jeadie by Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/320
* Matmul via f16 when possible by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/317

New Contributors
* keisuke-niimi-insightedge-jp made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/300
* Jeadie made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/308

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.7...v0.1.8

What's Changed
* Add terminate on next step handler via ctrlc by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/301
* Update containers to cuda 12.4 + Fix missing libraries by LLukas22 in https://github.com/EricLBuehler/mistral.rs/pull/302


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.6...v0.1.7

This release has relatively few changes, its major purpose is to update the containers and synchronize the versions.