Bentoml

Latest version: v1.4.4

Safety actively analyzes 714875 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 6 of 27

1.3.0

We are excited to announce the release of BentoML 1.3! Following the feedback received since the launch of 1.2 earlier this year, we are introducing a host of new features and enhancements in 1.3. Below are the key highlights of 1.3 and stay tuned for an upcoming blog post, where we'll provide a detailed exploration of the new features and the driving forces behind the development.

Here are some of the important points to note about 1.3:

- `1.3` ensures full backward compatibility, meaning that Bentos built with `1.2` will continue to work seamlessly with this release.
- We remain committed to supporting `1.2`. Critical bug fixes and security updates will be backported to the `1.2` branch.
- The [BentoML documentation](https://docs.bentoml.com/en/latest/index.html) has been updated with examples and guides for `1.3`. More guides will be added in the coming weeks.
- BentoCloud supports Bento Deployments from both `1.2` and `1.3` releases of BentoML.

Now, let’s take a look at the major features and enhancements:

🕙 Implemented BentoML task execution

- Introduced the `bentoml.task` decorator to set a task endpoint for executing a long-running workload (such as batch processing or video generation).
- Added the `.submit()` method to both the sync and async clients, which can submit task inputs via the task endpoint and dedicated worker processes constantly monitor task queues for new work to perform.
- Full compatibility with BentoCloud to run Bentos defined with task endpoints.
- See the [Services](https://docs.bentoml.com/en/latest/guides/services.html) and [Clients](https://docs.bentoml.com/en/latest/guides/clients.html) doc with examples of a Service API by initializing a long running task in the Service constructor, creating clients to call the endpoint, and retrieving task status.

🚀 Optimized the build cache to accelerate the build process

- Enhanced build speed for `bentoml build` & `containerize` through pre-installed large packages like `torch`
- Switch to `uv` as the installer and resolver, replacing `pip`

🔨 Supported concurrency-based autoscaling on BentoCloud

- Added the `concurrency` configuration to the `bentoml.service` decorator to set the ideal number of simultaneous requests a Service is designed to handle.
- Added the `external_queue` configuration to the `bentoml.service` decorator to queue excess requests until they can be processed within the defined `concurrency` limits.
- See the [documentation](https://docs.bentoml.com/en/latest/bentocloud/how-tos/autoscaling.html) to configure concurrency and external queue.

🔒 Secure data handling with [secrets](https://docs.bentoml.com/en/latest/bentocloud/how-tos/manage-secrets.html) in BentoCloud:

- You can now create and manage credentials, such as HuggingFace tokens and AWS secrets, securely on BentoCloud and easily apply them across multiple Deployments.
- Added secret subcommands to the BentoML CLI for secret management. Run `bentoml secret -h` to learn more.

🗒️ Added streamed logs for Bento image deployment.

- Easier to troubleshoot build issues and enable faster development iterations

🙏 Thank you for your continued support!

What's Changed
* fix: change forbid extra keys to false for bentocloud by FogDong in https://github.com/bentoml/BentoML/pull/4866
* feat(dev): 1.3 by frostming in https://github.com/bentoml/BentoML/pull/4849
* fix: delete cluster and ns if it is first cluster by FogDong in https://github.com/bentoml/BentoML/pull/4869
* fix: auto login confirm ask logic by xianml in https://github.com/bentoml/BentoML/pull/4864
* fix: secret default value by xianml in https://github.com/bentoml/BentoML/pull/4870
* fix: fix typo in error msg by FogDong in https://github.com/bentoml/BentoML/pull/4871


**Full Changelog**: https://github.com/bentoml/BentoML/compare/v1.2.20...v1.3.0

1.3.0a3

What's Changed
* fix: don't fail when image pod is not found by frostming in https://github.com/bentoml/BentoML/pull/4862
* fix: async task response deserialization crash by frostming in https://github.com/bentoml/BentoML/pull/4865


**Full Changelog**: https://github.com/bentoml/BentoML/compare/v1.3.0a2...v1.3.0a3

1.3.0a2

What's Changed
* fix: options are not required by xianml in https://github.com/bentoml/BentoML/pull/4861


**Full Changelog**: https://github.com/bentoml/BentoML/compare/v1.3.0a1...v1.3.0a2

1.3.0a1

What's Changed
* feat: get_service api for selected frameworks by frostming in https://github.com/bentoml/BentoML/pull/4782
* feat: cli auto login by xianml in https://github.com/bentoml/BentoML/pull/4817
* feat: use rich.print to replace click.echo by frostming in https://github.com/bentoml/BentoML/pull/4827
* chore: update print and fix cors error by xianml in https://github.com/bentoml/BentoML/pull/4829
* feat: login to current context instead of default context if --context is not passed by frostming in https://github.com/bentoml/BentoML/pull/4828
* feat: switch to uv as the resolver and installer by frostming in https://github.com/bentoml/BentoML/pull/4822
* feat: Officially support Python 3.12 by frostming in https://github.com/bentoml/BentoML/pull/4830
* Docs: Add auto cli login docs by Sherlock113 in https://github.com/bentoml/BentoML/pull/4844
* feat: retry and cancel task by frostming in https://github.com/bentoml/BentoML/pull/4852


**Full Changelog**: https://github.com/bentoml/BentoML/compare/v1.2.20...v1.3.0a1

1.2.20

What's Changed
* docs: Add logging and tracing docs by Sherlock113 in https://github.com/bentoml/BentoML/pull/4725
* feat: --label option for bentoml build by frostming in https://github.com/bentoml/BentoML/pull/4832
* docs: Update the concurrency doc by Sherlock113 in https://github.com/bentoml/BentoML/pull/4834
* docs: Update services.rst by vikramjit-sidhu in https://github.com/bentoml/BentoML/pull/4837
* docs: Update concurrency links by Sherlock113 in https://github.com/bentoml/BentoML/pull/4840
* docs: Fix broken link by Sherlock113 in https://github.com/bentoml/BentoML/pull/4841
* ci: pre-commit autoupdate [skip ci] by pre-commit-ci in https://github.com/bentoml/BentoML/pull/4838
* fix: stop spinner before starting to stream logs by frostming in https://github.com/bentoml/BentoML/pull/4846
* docs: Add azure byoc setup doc by Sherlock113 in https://github.com/bentoml/BentoML/pull/4847
* docs: Update the BYOC architecture image by Sherlock113 in https://github.com/bentoml/BentoML/pull/4848
* fix: fix error message with trace id by FogDong in https://github.com/bentoml/BentoML/pull/4853
* doc: locking by bojiang in https://github.com/bentoml/BentoML/pull/4850
* fix(containerize): command to create group and user in alpine base image by frostming in https://github.com/bentoml/BentoML/pull/4855
* fix: encode special charaters in path by frostming in https://github.com/bentoml/BentoML/pull/4854
* doc: locking for platform by frostming in https://github.com/bentoml/BentoML/pull/4858
* fix: correct the params passed to keras.save_model by frostming in https://github.com/bentoml/BentoML/pull/4857

New Contributors
* vikramjit-sidhu made their first contribution in https://github.com/bentoml/BentoML/pull/4837

**Full Changelog**: https://github.com/bentoml/BentoML/compare/v1.2.19...v1.2.20

1.2.19

What's Changed
* docs: Update diffusion model repos to the new one by Sherlock113 in https://github.com/bentoml/BentoML/pull/4797
* feat(monitoring): support GRPC LogExporter by judahrand in https://github.com/bentoml/BentoML/pull/4808
* docs: Add Docker deployment for Bentos by Sherlock113 in https://github.com/bentoml/BentoML/pull/4812
* docs: update examples service decorators with new features by ssheng in https://github.com/bentoml/BentoML/pull/4798
* doc: Custom Error Handling by jianshen92 in https://github.com/bentoml/BentoML/pull/4811
* doc: Wording change in error handling doc by Sherlock113 in https://github.com/bentoml/BentoML/pull/4813
* fix: ASCII animation was not working properly in the image builder logs by yetone in https://github.com/bentoml/BentoML/pull/4810
* fix: avoid editing list in during iteration by judahrand in https://github.com/bentoml/BentoML/pull/4809
* docs: Add secrets doc by Sherlock113 in https://github.com/bentoml/BentoML/pull/4814
* fix: improve the code of spinner and log tailer by frostming in https://github.com/bentoml/BentoML/pull/4815
* doc: Update the docs about multipart output by frostming in https://github.com/bentoml/BentoML/pull/4818
* docs: Add batch inference jobs doc by Sherlock113 in https://github.com/bentoml/BentoML/pull/4816
* doc: Fix typo and format by Sherlock113 in https://github.com/bentoml/BentoML/pull/4821
* fix(cli): hanging issue when deployment ready by frostming in https://github.com/bentoml/BentoML/pull/4825
* fix(deployment-client): add build process and extend url by Haivilo in https://github.com/bentoml/BentoML/pull/4790
* doc: Update vllm.rst by Sherlock113 in https://github.com/bentoml/BentoML/pull/4824
* docs: Add custom models use case doc by Sherlock113 in https://github.com/bentoml/BentoML/pull/4819
* docs: Reorg blip doc to multimodality section by Sherlock113 in https://github.com/bentoml/BentoML/pull/4826
* fix: inject prometheus multiproc_dir into env var when worker starts by frostming in https://github.com/bentoml/BentoML/pull/4820


**Full Changelog**: https://github.com/bentoml/BentoML/compare/v1.2.18...v1.2.19

Page 6 of 27

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.