Usage
To start a LLM: python -m openllm start HuggingFaceH4/zephyr-7b-beta
Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)
What's Changed
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/870
* chore(deps): bump taiki-e/install-action from 2.25.9 to 2.26.18 by dependabot in https://github.com/bentoml/OpenLLM/pull/899
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/909
* chore(deps): bump github/codeql-action from 3.23.1 to 3.24.3 by dependabot in https://github.com/bentoml/OpenLLM/pull/908
* chore(deps): bump sigstore/cosign-installer from 3.3.0 to 3.4.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/907
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/931
* feat: 1.2 APIs by aarnphm in https://github.com/bentoml/OpenLLM/pull/821
* chore(deps): bump taiki-e/install-action from 2.26.18 to 2.27.9 by dependabot in https://github.com/bentoml/OpenLLM/pull/920
* chore(deps): bump next from 13.4.8 to 13.5.1 by dependabot in https://github.com/bentoml/OpenLLM/pull/912
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/935
* chore(deps): bump marocchino/sticky-pull-request-comment from 2.8.0 to 2.9.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/933
* chore(deps): bump aquasecurity/trivy-action from 0.16.1 to 0.18.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/932
* chore(deps): bump docker/setup-buildx-action from 3.0.0 to 3.2.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/941
* chore(deps): bump github/codeql-action from 3.24.3 to 3.24.9 by dependabot in https://github.com/bentoml/OpenLLM/pull/939
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/942
* fix(compat): use annotated type from `typing_compat` by rudeigerc in https://github.com/bentoml/OpenLLM/pull/943
* docs: Update high-level messaging by Sherlock113 in https://github.com/bentoml/OpenLLM/pull/949
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/947
* chore(deps): bump aquasecurity/trivy-action from 0.18.0 to 0.19.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/946
* chore(deps): bump taiki-e/install-action from 2.27.9 to 2.32.9 by dependabot in https://github.com/bentoml/OpenLLM/pull/945
* Update README.md by parano in https://github.com/bentoml/OpenLLM/pull/964
* chore(deps): bump taiki-e/install-action from 2.32.9 to 2.33.9 by dependabot in https://github.com/bentoml/OpenLLM/pull/970
* chore(deps): bump sigstore/cosign-installer from 3.4.0 to 3.5.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/954
* chore(deps): bump docker/metadata-action from 5.5.0 to 5.5.1 by dependabot in https://github.com/bentoml/OpenLLM/pull/956
* chore(deps): bump actions/setup-python from 5.0.0 to 5.1.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/955
* chore(deps): bump pypa/gh-action-pypi-publish from 1.8.11 to 1.8.14 by dependabot in https://github.com/bentoml/OpenLLM/pull/958
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/959
* fix: update correct CompletionOutput object by aarnphm in https://github.com/bentoml/OpenLLM/pull/973
* chore(deps): bump docker/build-push-action from 5.1.0 to 5.3.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/979
* chore(deps): bump docker/login-action from 3.0.0 to 3.1.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/978
* chore(deps): bump github/codeql-action from 3.24.9 to 3.25.3 by dependabot in https://github.com/bentoml/OpenLLM/pull/977
* chore(deps): bump docker/setup-buildx-action from 3.2.0 to 3.3.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/975
* fix: make sure to respect additional parameters parse by aarnphm in https://github.com/bentoml/OpenLLM/pull/981
* chore(deps): bump peter-evans/create-pull-request from 5.0.2 to 6.0.5 by dependabot in https://github.com/bentoml/OpenLLM/pull/976
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/980
* chore(deps): bump rlespinasse/github-slug-action from 4.4.1 to 4.5.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/988
* chore(deps): bump softprops/action-gh-release from 1 to 2 by dependabot in https://github.com/bentoml/OpenLLM/pull/987
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/989
* chore(deps): bump taiki-e/install-action from 2.33.9 to 2.33.22 by dependabot in https://github.com/bentoml/OpenLLM/pull/985
* chore(deps): bump actions/checkout from 4.1.1 to 4.1.5 by dependabot in https://github.com/bentoml/OpenLLM/pull/984
* chore(deps): bump next from 13.4.8 to 14.1.1 by dependabot in https://github.com/bentoml/OpenLLM/pull/983
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/994
* chore(deps): bump actions/checkout from 4.1.5 to 4.1.6 by dependabot in https://github.com/bentoml/OpenLLM/pull/993
* chore(deps): bump github/codeql-action from 3.25.3 to 3.25.5 by dependabot in https://github.com/bentoml/OpenLLM/pull/992
* chore(deps): bump aquasecurity/trivy-action from 0.19.0 to 0.20.0 by dependabot in https://github.com/bentoml/OpenLLM/pull/991
* fix(docs): update correct BentoML links by dennisrall in https://github.com/bentoml/OpenLLM/pull/995
* tests: add additional basic testing by aarnphm in https://github.com/bentoml/OpenLLM/pull/982
* infra: prepare 0.5 releases by aarnphm in https://github.com/bentoml/OpenLLM/pull/996
* chore(deps): bump actions/upload-artifact from 3.1.3 to 4.3.3 by dependabot in https://github.com/bentoml/OpenLLM/pull/986
* chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7 by dependabot in https://github.com/bentoml/OpenLLM/pull/990
* chore(qol): update CLI options and performance upgrade for build cache by aarnphm in https://github.com/bentoml/OpenLLM/pull/997
* feat(ci): running CI on paperspace by aarnphm in https://github.com/bentoml/OpenLLM/pull/998
* chore(deps): bump taiki-e/install-action from 2.33.22 to 2.33.34 by dependabot in https://github.com/bentoml/OpenLLM/pull/1000
* ci: pre-commit autoupdate [pre-commit.ci] by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/1002
New Contributors
* rudeigerc made their first contribution in https://github.com/bentoml/OpenLLM/pull/943
* dennisrall made their first contribution in https://github.com/bentoml/OpenLLM/pull/995
**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.4.44...v0.5.0