Deepspeed-mii

What's Changed
* Update version.txt after 0.2.2 release by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/413
* Add RTD by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/321
* Add test for loading from local dir by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/414
* Remove references to --extra-index-url in MII repo by loadams in https://github.com/microsoft/DeepSpeed-MII/pull/421
* Add quantization config option by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/433


**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.2.2...v0.2.3

What's Changed
* Update version.txt after 0.2.1 release by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/404
* Fix for missing EOS token by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/408
* text2img task to support negative prompts by gauravrajguru in https://github.com/microsoft/DeepSpeed-MII/pull/407
* Disable model check in UT by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/411
* fix: Fixed the issue where the mii.pipeline.pipe(stop) was ineffective by kitstar in https://github.com/microsoft/DeepSpeed-MII/pull/409
* Add support for inpainting task in DS-MII by gauravrajguru in https://github.com/microsoft/DeepSpeed-MII/pull/410

New Contributors
* kitstar made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/409

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.2.1...v0.2.2

What's Changed
* Update version.txt after 0.2.0 release by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/382
* Error on unknown generate fields by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/386
* Make the order of outputs the same as the order of inputs when using `mii.pipeline` by s-jse in https://github.com/microsoft/DeepSpeed-MII/pull/384
* Update landing page by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/391
* Update CI workflows by loadams in https://github.com/microsoft/DeepSpeed-MII/pull/392
* Fix recovery from deadlock by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/394
* Readable token streaming support by greshilov in https://github.com/microsoft/DeepSpeed-MII/pull/397
* Fix generate output order by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/401
* Improve recovery from KV cache starvation by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/403
* Adding OpenAI Compatible RESTful API by PawanOsman in https://github.com/microsoft/DeepSpeed-MII/pull/317

New Contributors
* s-jse made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/384
* greshilov made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/397
* PawanOsman made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/317

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.2.0...v0.2.1

New Features
* [DeepSpeed-FastGen: Introducting Mixtral, Phi-2, and Falcon support with major performance and feature enhancements.](https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-fastgen/2024-01-19)

What's Changed
* Update version.txt after 0.1.3 release by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/355
* Add pipeline unit tests by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/359
* Update supported models list by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/360
* Add restful_api_host into server args. by sarattha in https://github.com/microsoft/DeepSpeed-MII/pull/364
* fix bug when mii_config is None by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/367
* fix address already in use error on UT by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/369
* Restrict when legacy unit tests are run by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/370
* Make generate params pydantic model by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/372
* Add model support unit test by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/373
* Improve efficiency of scheduling and token sampiling by tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/377
* Update required DS version by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/380

New Contributors
* sarattha made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/364

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.1.3...v0.2.0

What's Changed
* Add RESTful API option for host by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/348
* Fix for error messages in persistent deployment by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/350
* Loosen unit test performance assert by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/352
* Add device map config by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/331


**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.1.2...v0.1.3

What's Changed
* Update RESTful API by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/294
* Compatibility with DS Inference KV-cache flexibility PR by cmikeh2 in https://github.com/microsoft/DeepSpeed-MII/pull/284
* Use smaller model for unit tests by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/315
* Unify input/output types by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/295
* Multi-process RESTful API by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/328
* Add support for zero shot image classification task by PhaniShekhar in https://github.com/microsoft/DeepSpeed-MII/pull/326
* Add safetensors support by jihnenglin in https://github.com/microsoft/DeepSpeed-MII/pull/296
* Handling of edge case for text to image model by gauravrajguru in https://github.com/microsoft/DeepSpeed-MII/pull/334
* fix PR creation in release workflow by mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/337

New Contributors
* cmikeh2 made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/284
* PhaniShekhar made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/326
* jihnenglin made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/296

**Full Changelog**: https://github.com/microsoft/DeepSpeed-MII/compare/v0.1.1...v0.1.2