Lightning

What's Changed
* Bump Lightning-AI/utilities from 0.11.3.post0 to 0.11.5 by dependabot in https://github.com/Lightning-AI/LitServe/pull/172
* fix flaky timeout test by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/176
* Add max payload size middleware by andyland in https://github.com/Lightning-AI/LitServe/pull/174
* Make mp.Queue.get async for response queue by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/178
* bump version v0.1.4 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/180


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.3...v0.1.4

What's Changed
* Add Stable Audio example to README.md by andyland in https://github.com/Lightning-AI/LitServe/pull/135
* custom api endpoint path by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/136
* run LitServe with minimal dependency by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/138
* inject context for batching loops by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/139
* propagate error with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/143
* Bump pypa/gh-action-pypi-publish from 1.8.14 to 1.9.0 by dependabot in https://github.com/Lightning-AI/LitServe/pull/142
* remove busy wait from data_streamer by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/140
* raise HTTPException from LitAPI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/145
* avoid multiple `get_event_loop` calls by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/148
* bugfix: OpenAISpec populate missing `zip` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/149
* optimize batch aggregation by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/147
* feat: Add ability to customize authorization method by andyland in https://github.com/Lightning-AI/LitServe/pull/151
* add type hint and reorg function definition by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/152
* implement OpenAI token usage by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/150
* feat: Support gzip by andyland in https://github.com/Lightning-AI/LitServe/pull/153
* Add AudioCraft example by andyland in https://github.com/Lightning-AI/LitServe/pull/154
* ci: fix building package by Borda in https://github.com/Lightning-AI/LitServe/pull/157
* use `get_running_loop` over `get_event_loop` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/155
* Bump actions/upload-artifact & actions/download-artifact from 3 to 4 by dependabot in https://github.com/Lightning-AI/LitServe/pull/159
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/162
* Bump mypy from 1.9.0 to 1.10.1 by dependabot in https://github.com/Lightning-AI/LitServe/pull/161
* Update CODEOWNERS for develop requirements by Borda in https://github.com/Lightning-AI/LitServe/pull/163
* Multiple Queue architecture for process communication by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/164
* Fix: Support files > 1MB by andyland in https://github.com/Lightning-AI/LitServe/pull/169
* support openai image_url with detail settings by liangjs in https://github.com/Lightning-AI/LitServe/pull/168
* bugfix: cover disabled request timeout scenario for `collate_requests` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/167
* bump version for release by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/170

New Contributors
* liangjs made their first contribution in https://github.com/Lightning-AI/LitServe/pull/168

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.2...v0.1.3

What's Changed
* Add option to disable automatic client.py generation by rasbt in https://github.com/Lightning-AI/LitServe/pull/131
* fix: join chat message content, removing empty space by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/132
* Fix Starlette streaming responses by apaz-cli in https://github.com/Lightning-AI/LitServe/pull/133
* bump version for release by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/134

New Contributors
* apaz-cli made their first contribution in https://github.com/Lightning-AI/LitServe/pull/133

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.1...v0.1.2

What's Changed
* Fix macos CI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/62
* batched streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/55
* fix: broken pipes caused inference worker to fail by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/61
* fix: default unbatch always generator by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/68
* document streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/49
* document accelerator=auto by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/64
* document batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/65
* allow timeout disable by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/63
* Add devices auto by lantiga in https://github.com/Lightning-AI/LitServe/pull/69
* add license info by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/74
* allow to set mps accelerator explicitly by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/73
* add readme improvements by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/70
* decouple decode_request from get_batch_from_uid by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/79
* fix cuda forking error by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/77
* feat: Support multipart & url-encoded form bodies by andyland in https://github.com/Lightning-AI/LitServe/pull/80
* Let the user know when "setup" has completed... by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/82
* format encoded response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/85
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/78
* improve logging by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/87
* Update server.py by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/89
* removes `/stream-predict` endpoint and standardizes to `/predict` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/93
* validate port by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/92
* Bump version since litserve is different from the last released version by rasbt in https://github.com/Lightning-AI/LitServe/pull/94
* Add Stream API Example by rasbt in https://github.com/Lightning-AI/LitServe/pull/95
* add openai spec v0 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/76
* Exclude markdown files from pre-commit formatter by rasbt in https://github.com/Lightning-AI/LitServe/pull/96
* fix summary tag by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/97
* add client detail to streaming document by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/98
* Fix installation instructions for case sensitive file systems by rasbt in https://github.com/Lightning-AI/LitServe/pull/102
* Improve docs for OpenAI spec by lantiga in https://github.com/Lightning-AI/LitServe/pull/100
* add newline while streaming JSON objects by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/105
* fix pipe reuse by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/108
* add openai streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/101
* Add real docs! by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/114
* feat: Update OpenAI spec to include image url in message content by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/113
* feat: Update OpenAI spec to include support for tools by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/119
* inject context to share/log values across LitAPI methods by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/118
* Track device automatically by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/123
* fix: kill process by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/124
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/125
* pre-populate context with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/126
* Bump version for new release by rasbt in https://github.com/Lightning-AI/LitServe/pull/127

New Contributors
* andyland made their first contribution in https://github.com/Lightning-AI/LitServe/pull/80
* pre-commit-ci made their first contribution in https://github.com/Lightning-AI/LitServe/pull/78
* rasbt made their first contribution in https://github.com/Lightning-AI/LitServe/pull/94
* bhimrazy made their first contribution in https://github.com/Lightning-AI/LitServe/pull/113

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.0...v0.1.1

What's Changed
* Fix macos CI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/62
* batched streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/55
* fix: broken pipes caused inference worker to fail by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/61
* fix: default unbatch always generator by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/68
* document streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/49
* document accelerator=auto by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/64
* document batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/65
* allow timeout disable by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/63
* Add devices auto by lantiga in https://github.com/Lightning-AI/LitServe/pull/69
* add license info by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/74
* allow to set mps accelerator explicitly by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/73
* add readme improvements by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/70
* decouple decode_request from get_batch_from_uid by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/79
* fix cuda forking error by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/77
* feat: Support multipart & url-encoded form bodies by andyland in https://github.com/Lightning-AI/LitServe/pull/80
* Let the user know when "setup" has completed... by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/82
* format encoded response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/85
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/78
* improve logging by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/87
* Update server.py by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/89
* removes `/stream-predict` endpoint and standardizes to `/predict` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/93
* validate port by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/92
* Bump version since litserve is different from the last released version by rasbt in https://github.com/Lightning-AI/LitServe/pull/94
* Add Stream API Example by rasbt in https://github.com/Lightning-AI/LitServe/pull/95
* add openai spec v0 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/76
* Exclude markdown files from pre-commit formatter by rasbt in https://github.com/Lightning-AI/LitServe/pull/96
* fix summary tag by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/97
* add client detail to streaming document by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/98
* Fix installation instructions for case sensitive file systems by rasbt in https://github.com/Lightning-AI/LitServe/pull/102
* Improve docs for OpenAI spec by lantiga in https://github.com/Lightning-AI/LitServe/pull/100
* add newline while streaming JSON objects by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/105
* fix pipe reuse by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/108
* add openai streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/101
* Add real docs! by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/114
* feat: Update OpenAI spec to include image url in message content by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/113
* feat: Update OpenAI spec to include support for tools by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/119
* inject context to share/log values across LitAPI methods by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/118
* Track device automatically by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/123
* fix: kill process by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/124
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/125
* pre-populate context with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/126

New Contributors
* andyland made their first contribution in https://github.com/Lightning-AI/LitServe/pull/80
* pre-commit-ci made their first contribution in https://github.com/Lightning-AI/LitServe/pull/78
* rasbt made their first contribution in https://github.com/Lightning-AI/LitServe/pull/94
* bhimrazy made their first contribution in https://github.com/Lightning-AI/LitServe/pull/113

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.0...v0.1.1dev0

Additions

- dynamic batching https://github.com/Lightning-AI/litserve/pull/20
- streaming https://github.com/Lightning-AI/litserve/pull/37
- accelerator="auto" https://github.com/Lightning-AI/litserve/pull/44

Improvements

- concurrency