Litserve

Latest version: v0.2.7

Safety actively analyzes 714919 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 4

0.2.7

New Contributors
* Lucaz0619 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/422

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6...v0.2.7

0.2.7.dev0

What's Changed
* improve test timeouts by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/418
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/421
* git: Handle None values in ChatMessage content by Lucaz0619 in https://github.com/Lightning-AI/LitServe/pull/422
* fix custom exceptions by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/425
* fix: reponse format JSONSchema key fix by Lucaz0619 in https://github.com/Lightning-AI/LitServe/pull/427
* fix: ensure proper cleanup of processes in `wrap_litserve_start` by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/432
* fix async continuous batching by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/429
* [fix] continuous batching - fix prefill by ali-alshaar7 in https://github.com/Lightning-AI/LitServe/pull/433
* Feat: add custom health check logic by bhimrazy in https://github.com/Lightning-AI/LitServe/pull/430

New Contributors
* Lucaz0619 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/422

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6...v0.2.7.dev0

0.2.6

* fix: don't start zmq when fast_queue=false by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/417
* fix release ci by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/416

New Contributors
* rittik9 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/375
* ali-alshaar7 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/380

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.5...v0.2.6

0.2.6.dev3

What's Changed
* Set LitServer.stream using LitSpec.stream by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/398
* fix openai usage info for non-streaming response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/399
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/400
* Async continuous batching loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/401
* add validation for `stream=False` with `yield` usage by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/402
* fix callback runner to execute after predict by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/406
* integrate zmq by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/403
* warn users when predict/unbatch output length is not same as requests by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/408
* move built in loops inside classes by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/409
* add justus and thomas as codeowners by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/410
* enable multiple workers for ZMQ by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/411


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev2...v0.2.6.dev3

0.2.6.dev2

What's Changed
* Make `LitAPI.predict` optional and validate API implementation by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/394
* Fix OpenAISpec with continuous batching loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/395
* add tests for continuous batching and Default loops by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/396


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev1...v0.2.6.dev2

0.2.6.dev1

What's Changed
* Update PR template by rittik9 in https://github.com/Lightning-AI/LitServe/pull/381
* Include user field and `base64` literal for encoding_format by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/388
* Improve error handling and debugging experience by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/389
* improved logging with sensible defaults by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/391
* add continuous batching loop 1/n by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/387
* Add `loop.pre_setup` to allow fine-grained LitAPI validation based on inference loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/393


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev0...v0.2.6.dev1

Page 1 of 4

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.