Litserve

Latest version: v0.2.6

Safety actively analyzes 707299 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 4

0.2.6

* fix: don't start zmq when fast_queue=false by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/417
* fix release ci by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/416

New Contributors
* rittik9 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/375
* ali-alshaar7 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/380

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.5...v0.2.6

0.2.6.dev3

What's Changed
* Set LitServer.stream using LitSpec.stream by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/398
* fix openai usage info for non-streaming response by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/399
* [pre-commit.ci] pre-commit suggestions by pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/400
* Async continuous batching loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/401
* add validation for `stream=False` with `yield` usage by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/402
* fix callback runner to execute after predict by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/406
* integrate zmq by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/403
* warn users when predict/unbatch output length is not same as requests by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/408
* move built in loops inside classes by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/409
* add justus and thomas as codeowners by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/410
* enable multiple workers for ZMQ by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/411


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev2...v0.2.6.dev3

0.2.6.dev2

What's Changed
* Make `LitAPI.predict` optional and validate API implementation by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/394
* Fix OpenAISpec with continuous batching loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/395
* add tests for continuous batching and Default loops by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/396


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev1...v0.2.6.dev2

0.2.6.dev1

What's Changed
* Update PR template by rittik9 in https://github.com/Lightning-AI/LitServe/pull/381
* Include user field and `base64` literal for encoding_format by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/388
* Improve error handling and debugging experience by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/389
* improved logging with sensible defaults by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/391
* add continuous batching loop 1/n by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/387
* Add `loop.pre_setup` to allow fine-grained LitAPI validation based on inference loop by aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/393


**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.6.dev0...v0.2.6.dev1

0.2.6.dev0

New Contributors
* rittik9 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/375
* ali-alshaar7 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/380

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.5...v0.2.6.dev0

0.2.5

New Contributors
* fabigr8 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/360
* akuma12 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/342
* AlexShukhman made their first contribution in https://github.com/Lightning-AI/LitServe/pull/363

**Full Changelog**: https://github.com/Lightning-AI/LitServe/compare/v0.2.4...v0.2.5

Page 1 of 4

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.