Litserve

Latest version: v0.2.4

Safety actively analyzes 681874 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 3

0.2.0.dev0

What's Changed
* Add warning message if `batch` and `unbatch` is implemented but max_batch_size is unset. by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/185
* cleanup: move middleware to utils by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/189
* Add meaningful error message if response queues are not initialized by rasbt in https://github.com/Lightning-AI/LitServe/pull/191
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/193
* add codeowners by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/194
* cleanup: fix test naming convention by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/190
* properly shutdown litserve workers by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/192
* provide uvicorn configs with kwargs by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/198
* remove uvicorn from argument names by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/199
* fix flaky batch timeout test by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/200
* moved wrap_litserve_start to utils by ankitsharma07 in https://github.com/Lightning-AI/LitServe/pull/201
* bump version by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/202

New Contributors
* ankitsharma07 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/201

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.5...v0.2.0.dev0

0.1.5

What's Changed
* Feat: adds health check endpoint by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/182
* Bump Lightning-AI/utilities from 0.11.5 to 0.11.6 by dependabot in https://github.com/Lightning-AI/LitServe/pull/184
* Bump mypy from 1.10.1 to 1.11.1 by dependabot in https://github.com/Lightning-AI/LitServe/pull/187
* scale uvicorn servers by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/186
* bump version by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/188


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.4...v0.1.5

What's Changed
* Feat: adds health check endpoint by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/182
* Bump Lightning-AI/utilities from 0.11.5 to 0.11.6 by dependabot in https://github.com/Lightning-AI/LitServe/pull/184
* Bump mypy from 1.10.1 to 1.11.1 by dependabot in https://github.com/Lightning-AI/LitServe/pull/187
* scale uvicorn servers by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/186
* bump version by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/188


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.4...v0.1.5

0.1.4

What's Changed
* Bump Lightning-AI/utilities from 0.11.3.post0 to 0.11.5 by dependabot in https://github.com/Lightning-AI/LitServe/pull/172
* fix flaky timeout test by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/176
* Add max payload size middleware by andyland in https://github.com/Lightning-AI/LitServe/pull/174
* Make mp.Queue.get async for response queue by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/178
* bump version v0.1.4 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/180


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.3...v0.1.4

0.1.3

What's Changed
* Add Stable Audio example to README.md by andyland in https://github.com/Lightning-AI/LitServe/pull/135
* custom api endpoint path by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/136
* run LitServe with minimal dependency by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/138
* inject context for batching loops by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/139
* propagate error with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/143
* Bump pypa/gh-action-pypi-publish from 1.8.14 to 1.9.0 by dependabot in https://github.com/Lightning-AI/LitServe/pull/142
* remove busy wait from data_streamer by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/140
* raise HTTPException from LitAPI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/145
* avoid multiple `get_event_loop` calls by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/148
* bugfix: OpenAISpec populate missing `zip` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/149
* optimize batch aggregation by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/147
* feat: Add ability to customize authorization method by andyland in https://github.com/Lightning-AI/LitServe/pull/151
* add type hint and reorg function definition by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/152
* implement OpenAI token usage by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/150
* feat: Support gzip by andyland in https://github.com/Lightning-AI/LitServe/pull/153
* Add AudioCraft example by andyland in https://github.com/Lightning-AI/LitServe/pull/154
* ci: fix building package by Borda in https://github.com/Lightning-AI/LitServe/pull/157
* use `get_running_loop` over `get_event_loop` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/155
* Bump actions/upload-artifact & actions/download-artifact from 3 to 4 by dependabot in https://github.com/Lightning-AI/LitServe/pull/159
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/162
* Bump mypy from 1.9.0 to 1.10.1 by dependabot in https://github.com/Lightning-AI/LitServe/pull/161
* Update CODEOWNERS for develop requirements by Borda in https://github.com/Lightning-AI/LitServe/pull/163
* Multiple Queue architecture for process communication by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/164
* Fix: Support files > 1MB by andyland in https://github.com/Lightning-AI/LitServe/pull/169
* support openai image_url with detail settings by liangjs in https://github.com/Lightning-AI/LitServe/pull/168
* bugfix: cover disabled request timeout scenario for `collate_requests` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/167
* bump version for release by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/170

New Contributors
* liangjs made their first contribution in https://github.com/Lightning-AI/LitServe/pull/168

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.2...v0.1.3

0.1.2

What's Changed
* Add option to disable automatic client.py generation by rasbt in https://github.com/Lightning-AI/LitServe/pull/131
* fix: join chat message content, removing empty space by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/132
* Fix Starlette streaming responses by apaz-cli in https://github.com/Lightning-AI/LitServe/pull/133
* bump version for release by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/134

New Contributors
* apaz-cli made their first contribution in https://github.com/Lightning-AI/LitServe/pull/133

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.1...v0.1.2

0.1.1

What's Changed
* Fix macos CI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/62
* batched streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/55
* fix: broken pipes caused inference worker to fail by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/61
* fix: default unbatch always generator by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/68
* document streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/49
* document accelerator=auto by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/64
* document batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/65
* allow timeout disable by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/63
* Add devices auto by lantiga in https://github.com/Lightning-AI/LitServe/pull/69
* add license info by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/74
* allow to set mps accelerator explicitly by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/73
* add readme improvements by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/70
* decouple decode_request from get_batch_from_uid by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/79
* fix cuda forking error by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/77
* feat: Support multipart & url-encoded form bodies by andyland in https://github.com/Lightning-AI/LitServe/pull/80
* Let the user know when "setup" has completed... by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/82
* format encoded response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/85
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/78
* improve logging by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/87
* Update server.py by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/89
* removes `/stream-predict` endpoint and standardizes to `/predict` by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/93
* validate port by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/92
* Bump version since litserve is different from the last released version by rasbt in https://github.com/Lightning-AI/LitServe/pull/94
* Add Stream API Example by rasbt in https://github.com/Lightning-AI/LitServe/pull/95
* add openai spec v0 by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/76
* Exclude markdown files from pre-commit formatter by rasbt in https://github.com/Lightning-AI/LitServe/pull/96
* fix summary tag by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/97
* add client detail to streaming document by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/98
* Fix installation instructions for case sensitive file systems by rasbt in https://github.com/Lightning-AI/LitServe/pull/102
* Improve docs for OpenAI spec by lantiga in https://github.com/Lightning-AI/LitServe/pull/100
* add newline while streaming JSON objects by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/105
* fix pipe reuse by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/108
* add openai streaming by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/101
* Add real docs! by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/114
* feat: Update OpenAI spec to include image url in message content by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/113
* feat: Update OpenAI spec to include support for tools by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/119
* inject context to share/log values across LitAPI methods by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/118
* Track device automatically by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/123
* fix: kill process by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/124
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/125
* pre-populate context with OpenAISpec by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/126
* Bump version for new release by rasbt in https://github.com/Lightning-AI/LitServe/pull/127

New Contributors
* andyland made their first contribution in https://github.com/Lightning-AI/LitServe/pull/80
* pre-commit-ci made their first contribution in https://github.com/Lightning-AI/LitServe/pull/78
* rasbt made their first contribution in https://github.com/Lightning-AI/LitServe/pull/94
* bhimrazy made their first contribution in https://github.com/Lightning-AI/LitServe/pull/113

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.1.0...v0.1.1

Page 2 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.