Deepspeed-mii

New features
* [DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference](https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-fastgen)

What's Changed
* MII v0.1.0 release by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/252


**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.9...v0.1.0

What's Changed
* Update version.txt after 0.0.8 release by loadams in https://github.com/microsoft/DeepSpeed-MII/pull/246
* Introduce pydantic_v1 compatibility module for pydantic>=2.0.0 support by ringohoffman in https://github.com/microsoft/DeepSpeed-MII/pull/240
* Improved the code quality to ease future maintenance by blackmambaza in https://github.com/microsoft/DeepSpeed-MII/pull/248

New Contributors
* ringohoffman made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/240
* blackmambaza made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/248

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.8...v0.0.9

What's Changed
* Fixes for AML metatensor loading by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/244
* Update autoPR creation in release script by loadams in https://github.com/microsoft/DeepSpeed-MII/pull/245

New Contributors
* loadams made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/245

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.7...v0.0.8

What's Changed
* Cache HF API results by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/233
* Refactor Configs by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/218
* Re-enable non persistent test cases by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/238
* Add PyPI release workflow by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/239


**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.6...v0.0.7

What's Changed
* Fix error of creating session by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/217
* Auto-generate host files by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/228
* update txt2img example to sd 1.5 by lalalune in https://github.com/microsoft/DeepSpeed-MII/pull/73
* refactor(example): conversational-query by Thytu in https://github.com/microsoft/DeepSpeed-MII/pull/79
* Free torch cache after loading model by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/121
* Add distilbert support by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/126
* Update Stable Diffusion to match latest DeepSpeed-Inference by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/229

New Contributors
* lalalune made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/73

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.5...v0.0.6

What's Changed
* Tests use transformers cache for model storage by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/122
* Decouple conversions for gRPC from server/client code by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/138
* Separate server and client by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/142
* Add max_tokens option to mii_config by mallorbc in https://github.com/microsoft/DeepSpeed-MII/pull/129
* Fix for CPU device error by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/148
* Load balancing and multiple replicas by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/147
* RESTful API support by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/154
* Add Apache 2.0 License by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/165
* Fix condition to terminate RESTful API gateway by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/175
* Add lock to serialize pipeline execution by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/176
* Add session to enable multi-turn conversation by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/177
* Update CI by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/196
* Fix hostfile generation for replicas by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/192
* Fix deployment name in AML examples by novaturient95 in https://github.com/microsoft/DeepSpeed-MII/pull/193
* Refactored all grpc methods in method_table by TosinSeg in https://github.com/microsoft/DeepSpeed-MII/pull/202
* Add Non-persistent deployment type by TosinSeg in https://github.com/microsoft/DeepSpeed-MII/pull/197
* add llama and update readme counts by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/206
* Generalize meta tensor pipeline by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/199
* Always enable load balancing by TosinSeg in https://github.com/microsoft/DeepSpeed-MII/pull/205
* Improve unit tests by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/209
* Adding trust_remote_code support by msinha251 in https://github.com/microsoft/DeepSpeed-MII/pull/203
* Update AML Deployment by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/211

New Contributors
* tohtana made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/138
* mallorbc made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/129
* novaturient95 made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/193
* TosinSeg made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/202
* msinha251 made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/203

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.4...v0.0.5