Litserve

What's Changed
* Add option to disable automatic client.py generation by rasbt in https://github.com/Lightning-AI/LitServe/pull/131
* fix: join chat message content, removing empty space by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/132
* Fix Starlette streaming responses by apaz-cli in https://github.com/Lightning-AI/LitServe/pull/133
* bump version for release by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/134

New Contributors
* apaz-cli made their first contribution in https://github.com/Lightning-AI/LitServe/pull/133

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.1...v0.1.2

What's Changed
* Fix macos CI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/62
* batched streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/55
* fix: broken pipes caused inference worker to fail by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/61
* fix: default unbatch always generator by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/68
* document streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/49
* document accelerator=auto by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/64
* document batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/65
* allow timeout disable by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/63
* Add devices auto by lantiga in https://github.com/Lightning-AI/LitServe/pull/69
* add license info by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/74
* allow to set mps accelerator explicitly by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/73
* add readme improvements by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/70
* decouple decode_request from get_batch_from_uid by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/79
* fix cuda forking error by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/77
* feat: Support multipart & url-encoded form bodies by andyland in https://github.com/Lightning-AI/LitServe/pull/80
* Let the user know when "setup" has completed... by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/82
* format encoded response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/85
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/78
* improve logging by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/87
* Update server.py by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/89
* removes `/stream-predict` endpoint and standardizes to `/predict` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/93
* validate port by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/92
* Bump version since litserve is different from the last released version by rasbt in https://github.com/Lightning-AI/LitServe/pull/94
* Add Stream API Example by rasbt in https://github.com/Lightning-AI/LitServe/pull/95
* add openai spec v0 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/76
* Exclude markdown files from pre-commit formatter by rasbt in https://github.com/Lightning-AI/LitServe/pull/96
* fix summary tag by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/97
* add client detail to streaming document by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/98
* Fix installation instructions for case sensitive file systems by rasbt in https://github.com/Lightning-AI/LitServe/pull/102
* Improve docs for OpenAI spec by lantiga in https://github.com/Lightning-AI/LitServe/pull/100
* add newline while streaming JSON objects by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/105
* fix pipe reuse by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/108
* add openai streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/101
* Add real docs! by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/114
* feat: Update OpenAI spec to include image url in message content by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/113
* feat: Update OpenAI spec to include support for tools by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/119
* inject context to share/log values across LitAPI methods by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/118
* Track device automatically by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/123
* fix: kill process by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/124
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/125
* pre-populate context with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/126
* Bump version for new release by rasbt in https://github.com/Lightning-AI/LitServe/pull/127

New Contributors
* andyland made their first contribution in https://github.com/Lightning-AI/LitServe/pull/80
* pre-commit-ci made their first contribution in https://github.com/Lightning-AI/LitServe/pull/78
* rasbt made their first contribution in https://github.com/Lightning-AI/LitServe/pull/94
* bhimrazy made their first contribution in https://github.com/Lightning-AI/LitServe/pull/113

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.0...v0.1.1

What's Changed
* Fix macos CI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/62
* batched streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/55
* fix: broken pipes caused inference worker to fail by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/61
* fix: default unbatch always generator by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/68
* document streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/49
* document accelerator=auto by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/64
* document batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/65
* allow timeout disable by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/63
* Add devices auto by lantiga in https://github.com/Lightning-AI/LitServe/pull/69
* add license info by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/74
* allow to set mps accelerator explicitly by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/73
* add readme improvements by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/70
* decouple decode_request from get_batch_from_uid by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/79
* fix cuda forking error by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/77
* feat: Support multipart & url-encoded form bodies by andyland in https://github.com/Lightning-AI/LitServe/pull/80
* Let the user know when "setup" has completed... by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/82
* format encoded response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/85
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/78
* improve logging by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/87
* Update server.py by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/89
* removes `/stream-predict` endpoint and standardizes to `/predict` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/93
* validate port by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/92
* Bump version since litserve is different from the last released version by rasbt in https://github.com/Lightning-AI/LitServe/pull/94
* Add Stream API Example by rasbt in https://github.com/Lightning-AI/LitServe/pull/95
* add openai spec v0 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/76
* Exclude markdown files from pre-commit formatter by rasbt in https://github.com/Lightning-AI/LitServe/pull/96
* fix summary tag by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/97
* add client detail to streaming document by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/98
* Fix installation instructions for case sensitive file systems by rasbt in https://github.com/Lightning-AI/LitServe/pull/102
* Improve docs for OpenAI spec by lantiga in https://github.com/Lightning-AI/LitServe/pull/100
* add newline while streaming JSON objects by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/105
* fix pipe reuse by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/108
* add openai streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/101
* Add real docs! by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/114
* feat: Update OpenAI spec to include image url in message content by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/113
* feat: Update OpenAI spec to include support for tools by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/119
* inject context to share/log values across LitAPI methods by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/118
* Track device automatically by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/123
* fix: kill process by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/124
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/125
* pre-populate context with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/126

New Contributors
* andyland made their first contribution in https://github.com/Lightning-AI/LitServe/pull/80
* pre-commit-ci made their first contribution in https://github.com/Lightning-AI/LitServe/pull/78
* rasbt made their first contribution in https://github.com/Lightning-AI/LitServe/pull/94
* bhimrazy made their first contribution in https://github.com/Lightning-AI/LitServe/pull/113

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.0...v0.1.1dev0

Additions

- dynamic batching https://github.com/Lightning-AI/litserve/pull/20
- streaming https://github.com/Lightning-AI/litserve/pull/37
- accelerator="auto" https://github.com/Lightning-AI/litserve/pull/44

Improvements

- concurrency