Mistralrs

What's Changed
* refactor: `ModelKind` with `strum` + `derive_more` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/335
* Update dependencies by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/343
* Set device to cpu if loading isq by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/346
* Expose some APIs on the Rust side by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/348
* Propogating Regex init error by gregszumel in https://github.com/EricLBuehler/mistral.rs/pull/349
* Add a verbose mode by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/353
* Refactor `deserialize_chat_template` by Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/354
* Add support for using GGUF tokenizer by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/345

New Contributors
* gregszumel made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/349

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.10...v0.1.11

What's Changed
* Fixes and verbosity improvements for device mapping by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/332
* chore: `SimpleModelPaths` should be renamed to `LocalModelPaths` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/331
* Remove candle-layer-norm dep by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/333
* Refactor layers.rs by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/338
* chore: Simplify `utils/token.rs:get_token()` by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/328
* chore: Use `strum` to simplify `GGUFArchitecture` maintenance by polarathene in https://github.com/EricLBuehler/mistral.rs/pull/334
* Fix mistral model repeat kv by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/340

New Contributors
* polarathene made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/331

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.9...v0.1.10

What's Changed
* Improve chat templates docs by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/327
* Use cuBLASlt in attention by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/325


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.8...v0.1.9

Overview
- Documentation improvements
- Better handling of CTRL-C in interactive mode
- Matmul via low-precision kernels to take advantage of faster cuBLAS GEMM kernels (thanks lucasavila00)
- New loading API (thanks Jeadie)
- Various small bug fixes
- Reduce dependancy complexity (thanks LLukas22)

What's Changed
* bug fix: llama kv cache part by keisuke-niimi-insightedge-jp in https://github.com/EricLBuehler/mistral.rs/pull/300
* Refactor cache manager and kv cache by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/304
* Update the docs for ISQ and misc by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/310
* Make `pyo3` an optional dependency in `mistralrs-core` by LLukas22 in https://github.com/EricLBuehler/mistral.rs/pull/303
* Update kv cache by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/312
* Print gguf metadata consistently by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/313
* Allow loading LoRA without activating adapters and fix bugs by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/306
* Remove spurious tokenizer warnings by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/314
* Better handling of ctrlc by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/315
* Add analysis bot by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/316
* Quantized: Use cublas for prompt by lucasavila00 in https://github.com/EricLBuehler/mistral.rs/pull/238
* Support loading model into pipeline from local filesystem by Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/308
* Fix the ctrlc handler by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/318
* Don't force QLlama to have >2 input dims Jeadie by Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/320
* Matmul via f16 when possible by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/317

New Contributors
* keisuke-niimi-insightedge-jp made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/300
* Jeadie made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/308

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.7...v0.1.8

What's Changed
* Add terminate on next step handler via ctrlc by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/301
* Update containers to cuda 12.4 + Fix missing libraries by LLukas22 in https://github.com/EricLBuehler/mistral.rs/pull/302


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.6...v0.1.7

This release has relatively few changes, its major purpose is to update the containers and synchronize the versions.

What's Changed
* Causal Masking and model selection from `.toml` files by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/278
* Remove sliding window mask from quantized phi3 by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/280
* Fix Causal Mask by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/282
* Fix mask caching by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/283
* More intelligent scheduler by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/279
* Use `warn!` macro by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/289
* Use a public repo for tests tokenizer.json by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/290
* Implement Speculative Decoding by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/242
* Add X-LoRA support for GGUF by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/293
* Add some "senseful" fallbacks for `isq` by LLukas22 in https://github.com/EricLBuehler/mistral.rs/pull/272
* Implement dynamic LoRA swapping by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/262
* More verbose logging when loading locally by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/298
* Make speculative decoding faster without anything fancy by EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/297
* fix bug with mistralrs cuda by joshpopelka20 in https://github.com/EricLBuehler/mistral.rs/pull/299

New Contributors
* joshpopelka20 made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/299

New Features
- Speculative decoding introduced
- GGUF support for Phi 3
- Dynamic LoRA adapter activation support

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.5...v0.1.6