Openllm

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)

What's Changed
* fix: running MPT on CPU by aarnphm in https://github.com/bentoml/OpenLLM/pull/92
* tests: add sanity check for openllm.client by aarnphm in https://github.com/bentoml/OpenLLM/pull/93
* feat: custom dockerfile templates by aarnphm in https://github.com/bentoml/OpenLLM/pull/95
* feat(llm): fine-tuning Falcon by aarnphm in https://github.com/bentoml/OpenLLM/pull/98
* feat: add citation by aarnphm in https://github.com/bentoml/OpenLLM/pull/103
* peft: improve speed and quality by aarnphm in https://github.com/bentoml/OpenLLM/pull/102
* chore: fix mpt loading on single GPU by aarnphm in https://github.com/bentoml/OpenLLM/pull/105


**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.1.19...v0.1.20

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)



**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.1.18...v0.1.19

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)


What's Changed
* feat(start): `openllm start bento` by aarnphm in https://github.com/bentoml/OpenLLM/pull/80


**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.1.16...v0.1.17

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)

What's Changed
* chore: better gif quality by aarnphm in https://github.com/bentoml/OpenLLM/pull/71
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/74
* feat: cascading resource strategies by aarnphm in https://github.com/bentoml/OpenLLM/pull/72


**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.1.14...v0.1.15

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)


What's Changed
* models: migrate away from pipelines by aarnphm in https://github.com/bentoml/OpenLLM/pull/60
* fix(test): robustness by aarnphm in https://github.com/bentoml/OpenLLM/pull/64
* fix: converting envvar to string by aarnphm in https://github.com/bentoml/OpenLLM/pull/68
* chore: add more test matrices by aarnphm in https://github.com/bentoml/OpenLLM/pull/70
* feat: release binary distribution by aarnphm in https://github.com/bentoml/OpenLLM/pull/66


**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.1.13...v0.1.14

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the [CHANGELOG.md](https://github.com/bentoml/OpenLLM/blob/main/CHANGELOG.md)



**Full Changelog**: https://github.com/bentoml/OpenLLM/compare/v0.1.12...v0.1.13