Deepspeed-mii

What's Changed
* Fixes for AML metatensor loading by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/244
* Update autoPR creation in release script by loadams in https://github.com/microsoft/DeepSpeed-MII/pull/245

New Contributors
* loadams made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/245

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.7...v0.0.8

What's Changed
* Cache HF API results by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/233
* Refactor Configs by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/218
* Re-enable non persistent test cases by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/238
* Add PyPI release workflow by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/239


**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.6...v0.0.7

What's Changed
* Fix error of creating session by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/217
* Auto-generate host files by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/228
* update txt2img example to sd 1.5 by lalalune in https://github.com/microsoft/DeepSpeed-MII/pull/73
* refactor(example): conversational-query by Thytu in https://github.com/microsoft/DeepSpeed-MII/pull/79
* Free torch cache after loading model by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/121
* Add distilbert support by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/126
* Update Stable Diffusion to match latest DeepSpeed-Inference by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/229

New Contributors
* lalalune made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/73

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.5...v0.0.6

What's Changed
* Tests use transformers cache for model storage by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/122
* Decouple conversions for gRPC from server/client code by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/138
* Separate server and client by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/142
* Add max_tokens option to mii_config by mallorbc in https://github.com/microsoft/DeepSpeed-MII/pull/129
* Fix for CPU device error by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/148
* Load balancing and multiple replicas by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/147
* RESTful API support by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/154
* Add Apache 2.0 License by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/165
* Fix condition to terminate RESTful API gateway by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/175
* Add lock to serialize pipeline execution by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/176
* Add session to enable multi-turn conversation by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/177
* Update CI by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/196
* Fix hostfile generation for replicas by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/192
* Fix deployment name in AML examples by novaturient95 in https://github.com/microsoft/DeepSpeed-MII/pull/193
* Refactored all grpc methods in method_table by TosinSeg in https://github.com/microsoft/DeepSpeed-MII/pull/202
* Add Non-persistent deployment type by TosinSeg in https://github.com/microsoft/DeepSpeed-MII/pull/197
* add llama and update readme counts by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/206
* Generalize meta tensor pipeline by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/199
* Always enable load balancing by TosinSeg in https://github.com/microsoft/DeepSpeed-MII/pull/205
* Improve unit tests by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/209
* Adding trust_remote_code support by msinha251 in https://github.com/microsoft/DeepSpeed-MII/pull/203
* Update AML Deployment by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/211

New Contributors
* tohtana made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/138
* mallorbc made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/129
* novaturient95 made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/193
* TosinSeg made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/202
* msinha251 made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/203

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.4...v0.0.5

What's Changed
* Add community tutorial by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/104
* Add xlm-roberta by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/113
* Use new DS-Inference config API by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/108
* Improvements to VRAM usage when loading HF models by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/105
* Add Bloom model config checks for HF provider by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/107


**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.3...v0.0.4

What's Changed
* fix typo by TahaBinhuraib in https://github.com/microsoft/DeepSpeed-MII/pull/70
* move deserialize logic into wrapper to match diffusers api by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/77
* bump min deepspeed to 0.7.4 by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/82
* docs(deploy): update handled tasks by Thytu in https://github.com/microsoft/DeepSpeed-MII/pull/81
* fix(example): QnA model name by Thytu in https://github.com/microsoft/DeepSpeed-MII/pull/80
* Fix aio config dict in ZeRO text-gen example by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/88
* Support latest Transformers and new cache design by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/69
* use hf_auth_token in mii_config to huggingface provider by l-yohai in https://github.com/microsoft/DeepSpeed-MII/pull/76
* SD tutorial and benchmarks by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/90
* enable cuda graph for diffusers models by jeffra in https://github.com/microsoft/DeepSpeed-MII/pull/96

New Contributors
* TahaBinhuraib made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/70
* Thytu made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/81
* l-yohai made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/76

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.0.2...v0.0.3