Bentoml

This is a preview release for BentoML 1.0, check out the quick start guide here: https://docs.bentoml.org/en/latest/quickstart.html and documentation at http://docs.bentoml.org/

This is a preview release for BentoML 1.0, check out the quick start guide here: https://docs.bentoml.org/en/latest/quickstart.html and documentation at http://docs.bentoml.org/

This is a preview release for BentoML 1.0, check out the quick start guide here: https://docs.bentoml.org/en/latest/quickstart.html and documentation at http://docs.bentoml.org

This is a preview release for BentoML 1.0, check out the quick start guide here: https://docs.bentoml.org/en/latest/quickstart.html and documentation at http://docs.bentoml.org

Detailed Changelog: https://github.com/bentoml/BentoML/compare/v0.13.0...v0.13.1

Overview

BentoML 0.13.1 is a minor release containing mostly bug fixes and internal changes.

Changelog

* feat: SLO - API server max latency (1583)
* feat: Save OpenAPI Spec Json in BentoML bundle (1686)
* fix: BentoService loading user-provided env.yml file in runtime (1695)
* fix: BentoArtifact initialize with parameter issue (1696)
* fix: Use $BENTOML_PORT as Dockerfile default port (1706)
* fix: Fix missing s3_endpoint_url (1708)
* fix: Wrap request in sagemaker model_server (1716)

* refactor: Add deprecation warnings for deployment CLI commands (1718)
* refactor replace di framework (1697)
* ci: PaddlePaddle Intergration test (1739)

Detailed Changelog: https://github.com/bentoml/BentoML/compare/v0.12.1...v0.13.0

Overview

BentoML 0.13.0 is here! It's a release packed with lots of new features and important bug fixes. We encourage all users to upgrade.

❤️ Contributors

Thanks to aarnphm andrewsi-z larme gregd33 bojiang ssheng henrywu2019 yubozhao jack1902 illy sencenan parano soeque1 elia-secchi Shumpei-Kikuta StevenReitsma dsherry AnvithaGadagi joaquincabezas for the contributions!

📢 Breaking Changes

* Configuration revamp
* The `bentoml config` CLI command has been fully deprecated in this release
* New config system was introduced for configuring BentoML api server, yatai,
tracing and more (1543, 1595, 1615, 1667)
* Documentation: https://docs.bentoml.org/en/latest/guides/configuration.html
* Add --do-not-track CLI option and environment variable (1534)

* Deprecated --enable-microbatch flag
* Use the `api(batch=True|False)` option to choose between microbatch enabled
API vs. non-batch API
* For API defined in batch mode but requires serving online traffic without
batching behavior, use `--mb-max-batch-size=1` instead

🎉 New Features

* GPU Support
* GPU serving guide https://docs.bentoml.org/en/latest/guides/gpu_serving.html
* Added docker base image optimized for GPU serving (1653)

* Add support for EvalML (1603)

* Add support for ONNX-MLIR model (1545)

* Add full CORS support for bento API server (1576)

* Monitoring with Prometheus Gudie
* https://docs.bentoml.org/en/latest/guides/monitoring.html

* Optimize BentoML import delay (1608)

* Support upload/download for Yatai backed by local file system storage (1586)


🐞 Bug Fixes and Other Changes

* Add `ensure_ascii` option in JsonOutput (1578, 1580)

* Fix StringInput with batch=True API (1581)

* Fix docs.json link in API server UI (1633)

* Fix uploading to remote path (1601)

* Fix label missing after uploading Bento to remote Yatai (1598)

* Fixes /metrics endpoints with serve-gunicorn (1666)

* Upgrade conda to 4.9.2 in default docker base image (1525)

* Internal:
* Add locking mechanism to yatai server (1567)
* refactor: YataiService Store Abstraction (1541)