Litserve

Latest version: v0.2.7

Safety actively analyzes 723217 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 5

0.2.8.dev0

What's Changed
* Encapsulate multiprocessing communication by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/419
* fix context to have new object for each request by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/451
* fix: Starlette dependency issue by deependujha in https://github.com/Lightning-AI/LitServe/pull/456
* Document server hosting by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/458
* Update README.md by williamFalcon in https://github.com/Lightning-AI/LitServe/pull/459
* Update lightning serve CLI by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/460

New Contributors
* deependujha made their first contribution in https://github.com/Lightning-AI/LitServe/pull/456

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.7...v0.2.8.dev0

0.2.7

New Contributors
* Lucaz0619 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/422

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6...v0.2.7

0.2.7.dev0

What's Changed
* improve test timeouts by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/418
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/421
* git: Handle None values in ChatMessage content by Lucaz0619 in https://github.com/Lightning-AI/LitServe/pull/422
* fix custom exceptions by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/425
* fix: reponse format JSONSchema key fix by Lucaz0619 in https://github.com/Lightning-AI/LitServe/pull/427
* fix: ensure proper cleanup of processes in `wrap_litserve_start` by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/432
* fix async continuous batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/429
* [fix] continuous batching - fix prefill by ali-alshaar7 in https://github.com/Lightning-AI/LitServe/pull/433
* Feat: add custom health check logic by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/430

New Contributors
* Lucaz0619 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/422

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6...v0.2.7.dev0

0.2.6

* fix: don't start zmq when fast_queue=false by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/417
* fix release ci by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/416

New Contributors
* rittik9 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/375
* ali-alshaar7 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/380

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.5...v0.2.6

0.2.6.dev3

What's Changed
* Set LitServer.stream using LitSpec.stream by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/398
* fix openai usage info for non-streaming response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/399
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/400
* Async continuous batching loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/401
* add validation for `stream=False` with `yield` usage by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/402
* fix callback runner to execute after predict by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/406
* integrate zmq by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/403
* warn users when predict/unbatch output length is not same as requests by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/408
* move built in loops inside classes by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/409
* add justus and thomas as codeowners by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/410
* enable multiple workers for ZMQ by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/411


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev2...v0.2.6.dev3

0.2.6.dev2

What's Changed
* Make `LitAPI.predict` optional and validate API implementation by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/394
* Fix OpenAISpec with continuous batching loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/395
* add tests for continuous batching and Default loops by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/396


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev1...v0.2.6.dev2

Page 1 of 5

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.