Litellm

- Requires `openai>=1.0.0`
- `openai.InvalidRequestError` → `openai.BadRequestError`
- `openai.ServiceUnavailableError` → `openai.APIStatusError`
- *NEW* litellm client, allow users to pass api_key
- `litellm.Litellm(api_key="sk-123")`
- response objects now inherit from `BaseModel` (prev. `OpenAIObject`)
- *NEW* default exception - `APIConnectionError` (prev. `APIError`)
- litellm.get_max_tokens() now returns an int not a dict
python
max_tokens = litellm.get_max_tokens("gpt-3.5-turbo") returns an int not a dict
assert max_tokens==4097


Other updates
* Update function calling docs by kevinjyee in https://github.com/BerriAI/litellm/pull/673
* Fix data being overwritten by mc-marcocheng in https://github.com/BerriAI/litellm/pull/679
* Updating the docker image builder for GitHub Action by coconut49 in https://github.com/BerriAI/litellm/pull/678
* fix: bugs in traceloop integration by nirga in https://github.com/BerriAI/litellm/pull/647
* Router aembedding by mc-marcocheng in https://github.com/BerriAI/litellm/pull/691
* support release and debug params for langfuse client by SlapDrone in https://github.com/BerriAI/litellm/pull/695
* docs error ==> openai.error instead of openai.errors by josearangos in https://github.com/BerriAI/litellm/pull/700
* refactor Contributing to documentation steps by josearangos in https://github.com/BerriAI/litellm/pull/713
* Fix Router.set_model_list & Avoid overwriting litellm_params by mc-marcocheng in https://github.com/BerriAI/litellm/pull/706
* Update Together AI pricing by dedeswim in https://github.com/BerriAI/litellm/pull/724
* Update README.md by chinmay7016 in https://github.com/BerriAI/litellm/pull/727
* Router.get_available_deployment: Handle empty input edge case by mc-marcocheng in https://github.com/BerriAI/litellm/pull/729
* Fix caching for Router by karvetskiy in https://github.com/BerriAI/litellm/pull/722
* support for custom bedrock runtime endpoint by canada4663 in https://github.com/BerriAI/litellm/pull/717
* Use supplied headers by stanfea in https://github.com/BerriAI/litellm/pull/741
* Docker Hub image is built for ARM64 only by morgendigital in https://github.com/BerriAI/litellm/pull/734
* doc name chagne by kylehh in https://github.com/BerriAI/litellm/pull/764
* fix: fix bug for the case --model is not specified by clalanliu in https://github.com/BerriAI/litellm/pull/781
* add custom open ai models to asyncio call by PrathamSoni in https://github.com/BerriAI/litellm/pull/789
* Fix bad returns in get_available_deployment by nathankim7 in https://github.com/BerriAI/litellm/pull/790
* Improve message trimming by duc-phamh in https://github.com/BerriAI/litellm/pull/787
* build(deps): bump postcss from 8.4.27 to 8.4.31 in /docs/my-website by dependabot in https://github.com/BerriAI/litellm/pull/804
* build(deps): bump urllib3 from 2.0.5 to 2.0.7 by dependabot in https://github.com/BerriAI/litellm/pull/805
* build(deps): bump babel/traverse from 7.22.10 to 7.23.3 in /docs/my-website by dependabot in https://github.com/BerriAI/litellm/pull/806
* Fix ServiceUnavailableError super.__init__ error by jackmpcollins in https://github.com/BerriAI/litellm/pull/813
* Update Together prices by dedeswim in https://github.com/BerriAI/litellm/pull/814
* need to re-attempt backoff and yaml imports if the first import attempt fails by kfsone in https://github.com/BerriAI/litellm/pull/820
* Fix typo for initial_prompt_value and too many values to unpack error by rodneyxr in https://github.com/BerriAI/litellm/pull/826
* Bedrock llama by dchristian3188 in https://github.com/BerriAI/litellm/pull/811
* build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website by dependabot in https://github.com/BerriAI/litellm/pull/832

New Contributors
* kevinjyee made their first contribution in https://github.com/BerriAI/litellm/pull/673
* mc-marcocheng made their first contribution in https://github.com/BerriAI/litellm/pull/679
* SlapDrone made their first contribution in https://github.com/BerriAI/litellm/pull/695
* josearangos made their first contribution in https://github.com/BerriAI/litellm/pull/700
* dedeswim made their first contribution in https://github.com/BerriAI/litellm/pull/724
* chinmay7016 made their first contribution in https://github.com/BerriAI/litellm/pull/727
* karvetskiy made their first contribution in https://github.com/BerriAI/litellm/pull/722
* stanfea made their first contribution in https://github.com/BerriAI/litellm/pull/741
* morgendigital made their first contribution in https://github.com/BerriAI/litellm/pull/734
* clalanliu made their first contribution in https://github.com/BerriAI/litellm/pull/781
* PrathamSoni made their first contribution in https://github.com/BerriAI/litellm/pull/789
* nathankim7 made their first contribution in https://github.com/BerriAI/litellm/pull/790
* duc-phamh made their first contribution in https://github.com/BerriAI/litellm/pull/787
* dependabot made their first contribution in https://github.com/BerriAI/litellm/pull/804
* jackmpcollins made their first contribution in https://github.com/BerriAI/litellm/pull/813
* kfsone made their first contribution in https://github.com/BerriAI/litellm/pull/820
* rodneyxr made their first contribution in https://github.com/BerriAI/litellm/pull/826
* dchristian3188 made their first contribution in https://github.com/BerriAI/litellm/pull/811

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v0.11.1...v1.1.0

What's Changed
* Update __init__.py model_list to include bedrock models by canada4663 in https://github.com/BerriAI/litellm/pull/609
* proxy /models endpoint with the results of get_valid_models() by canada4663 in https://github.com/BerriAI/litellm/pull/611
* fix: llm_provider add openai finetune compatibility by Undertone0809 in https://github.com/BerriAI/litellm/pull/618
* Update README.md by Shivam250702 in https://github.com/BerriAI/litellm/pull/620
* Verbose warning by toniengelhardt in https://github.com/BerriAI/litellm/pull/625
* Update the Dockerfile of the LiteLLM Proxy server and some refactorings by coconut49 in https://github.com/BerriAI/litellm/pull/628
* fix: updates to traceloop docs by nirga in https://github.com/BerriAI/litellm/pull/639
* docs: fixed typo in Traceloop docs by nirga in https://github.com/BerriAI/litellm/pull/640
* fix: disabled batch by default for Traceloop by nirga in https://github.com/BerriAI/litellm/pull/643
* Create GitHub Action to automatically build docker images by coconut49 in https://github.com/BerriAI/litellm/pull/634
* Tutorial for using LiteLLM within Gradio Chatbot Application by dcruiz01 in https://github.com/BerriAI/litellm/pull/645
* proxy server: fix langroid part by pchalasani in https://github.com/BerriAI/litellm/pull/652
* Create GitHub Action to automatically build docker images by coconut49 in https://github.com/BerriAI/litellm/pull/655
* deepinfra: Add supported models by ichernev in https://github.com/BerriAI/litellm/pull/638
* Update index.md by Pratikdate in https://github.com/BerriAI/litellm/pull/663
* Add perplexity namespace to model pricing dict by toniengelhardt in https://github.com/BerriAI/litellm/pull/665
* Incorrect boto3 parameter name by shrikant14 in https://github.com/BerriAI/litellm/pull/671

New Contributors
* Undertone0809 made their first contribution in https://github.com/BerriAI/litellm/pull/618
* Shivam250702 made their first contribution in https://github.com/BerriAI/litellm/pull/620
* dcruiz01 made their first contribution in https://github.com/BerriAI/litellm/pull/645
* ichernev made their first contribution in https://github.com/BerriAI/litellm/pull/638
* Pratikdate made their first contribution in https://github.com/BerriAI/litellm/pull/663
* shrikant14 made their first contribution in https://github.com/BerriAI/litellm/pull/671

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v0.8.4...v0.11.1

🚨 IMPORTANT v0.8.4 has one major breaking change

- LiteLLM raises exceptions for models that do not support a specific param. Example, sending `functions` to `litellm.completion(model="claude-2", messages, functions)` raises an exception since claude-2 does not support function calling. To bypass the exception raised set `litellm.drop_params=True` More info here: https://docs.litellm.ai/docs/completion/input
- We now adopt semantic versioning for our releases [learn more about semantic versioning.](http://semver.org/)
- Check out LiteLLM Proxy - https://docs.litellm.ai/docs/proxy_server create an OpenAI compatible proxy to call 100+ LLMs in one I/O format


What's Changed
* Add missing litellm_provider for gpt-3.5-16k-0613 by mocy in https://github.com/BerriAI/litellm/pull/436
* added feedback button from feedbackrocket.io by NANDINI-star in https://github.com/BerriAI/litellm/pull/443
* Fix: merge conflict by bitsnaps in https://github.com/BerriAI/litellm/pull/495
* Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation. by coconut49 in https://github.com/BerriAI/litellm/pull/497
* added model openrouter/mistralai/mistral-7b-instruct with test by lucashofer in https://github.com/BerriAI/litellm/pull/498
* add bedrock.anthropic support for system prompt using <admin> tag by canada4663 in https://github.com/BerriAI/litellm/pull/499
* remove .DS_Store and update .gitignore by linediconsine in https://github.com/BerriAI/litellm/pull/500
* Update README.md by eltociear in https://github.com/BerriAI/litellm/pull/518
* Update utils.py by vedant-z in https://github.com/BerriAI/litellm/pull/530
* [docs] minor typo correction by Akash190104 in https://github.com/BerriAI/litellm/pull/537
* Readme Update by AnderMendoza in https://github.com/BerriAI/litellm/pull/556
* Add `host` option to `run_server()` by Sir-Photch in https://github.com/BerriAI/litellm/pull/558
* Add support for passing external bedrock clients to completion by zhooda in https://github.com/BerriAI/litellm/pull/562
* Add custom_openai type in provider list by kylehh in https://github.com/BerriAI/litellm/pull/560
* shorter langroid example, update section title by pchalasani in https://github.com/BerriAI/litellm/pull/581
* Fix usage open in colab link by biplobsd in https://github.com/BerriAI/litellm/pull/605

New Contributors
* mocy made their first contribution in https://github.com/BerriAI/litellm/pull/436
* bitsnaps made their first contribution in https://github.com/BerriAI/litellm/pull/495
* coconut49 made their first contribution in https://github.com/BerriAI/litellm/pull/497
* lucashofer made their first contribution in https://github.com/BerriAI/litellm/pull/498
* canada4663 made their first contribution in https://github.com/BerriAI/litellm/pull/499
* linediconsine made their first contribution in https://github.com/BerriAI/litellm/pull/500
* eltociear made their first contribution in https://github.com/BerriAI/litellm/pull/518
* vedant-z made their first contribution in https://github.com/BerriAI/litellm/pull/530
* Akash190104 made their first contribution in https://github.com/BerriAI/litellm/pull/537
* AnderMendoza made their first contribution in https://github.com/BerriAI/litellm/pull/556
* Sir-Photch made their first contribution in https://github.com/BerriAI/litellm/pull/558
* zhooda made their first contribution in https://github.com/BerriAI/litellm/pull/562
* kylehh made their first contribution in https://github.com/BerriAI/litellm/pull/560
* pchalasani made their first contribution in https://github.com/BerriAI/litellm/pull/581
* biplobsd made their first contribution in https://github.com/BerriAI/litellm/pull/605

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v0.1.738...v0.8.4

What's Changed
* remove DS_Store by happysalada in https://github.com/BerriAI/litellm/pull/315
* Update custom-mapping table to be more readable by pratik2315 in https://github.com/BerriAI/litellm/pull/305
* Add support for overriding API type for Azure calls by Taik in https://github.com/BerriAI/litellm/pull/330
* Fix proxy server railway deployment by Henry-Pulver in https://github.com/BerriAI/litellm/pull/338
* util: verify_access_key by WilliamEspegren in https://github.com/BerriAI/litellm/pull/346
* docs: add languages to code blocks by jordanbtucker in https://github.com/BerriAI/litellm/pull/348
* Add **kwargs to mock_completion by toniengelhardt in https://github.com/BerriAI/litellm/pull/367
* Simplify mock logic by toniengelhardt in https://github.com/BerriAI/litellm/pull/371
* added crisp chat by NANDINI-star in https://github.com/BerriAI/litellm/pull/372
* fix OpenAI completion model names by toniengelhardt in https://github.com/BerriAI/litellm/pull/373
* fix set correct mock response by toniengelhardt in https://github.com/BerriAI/litellm/pull/380
* Main by Phodaie in https://github.com/BerriAI/litellm/pull/388
* Add PROMPTMETHEUS to projects using LiteLLM by toniengelhardt in https://github.com/BerriAI/litellm/pull/390
* Rebuild stream chunks to openAI object by WilliamEspegren in https://github.com/BerriAI/litellm/pull/387
* Add Dashboard for showing error logs on exception by ishaan-jaff in https://github.com/BerriAI/litellm/pull/416

New Contributors
* happysalada made their first contribution in https://github.com/BerriAI/litellm/pull/315
* pratik2315 made their first contribution in https://github.com/BerriAI/litellm/pull/305
* Taik made their first contribution in https://github.com/BerriAI/litellm/pull/330
* Henry-Pulver made their first contribution in https://github.com/BerriAI/litellm/pull/338
* WilliamEspegren made their first contribution in https://github.com/BerriAI/litellm/pull/346
* jordanbtucker made their first contribution in https://github.com/BerriAI/litellm/pull/348
* toniengelhardt made their first contribution in https://github.com/BerriAI/litellm/pull/367
* Phodaie made their first contribution in https://github.com/BerriAI/litellm/pull/388
* ishaan-jaff made their first contribution in https://github.com/BerriAI/litellm/pull/416

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v0.1.574...v0.1.738

What's Changed
* fix: context propagation on acompletion method by galkleinman in https://github.com/BerriAI/litellm/pull/224
* feat: added support for OPENAI_API_BASE by ErikBjare in https://github.com/BerriAI/litellm/pull/222
* Fix streaming anthropic by adriensas in https://github.com/BerriAI/litellm/pull/185
* feat: traceloop docs by nirga in https://github.com/BerriAI/litellm/pull/227
* fix llmonitorLogger undefined by vincelwt in https://github.com/BerriAI/litellm/pull/235
* Add async iterator to fix/enable streaming responses by estill01 in https://github.com/BerriAI/litellm/pull/240
* docs: added traceloop to sidebar by nirga in https://github.com/BerriAI/litellm/pull/243
* Fix TypeError in Exception mapping by yujonglee in https://github.com/BerriAI/litellm/pull/247
* Remove unnecessary print in AI21 handling by yujonglee in https://github.com/BerriAI/litellm/pull/264
* added import aiohttp by shauryr in https://github.com/BerriAI/litellm/pull/294
* Update fastrepl repo by yujonglee in https://github.com/BerriAI/litellm/pull/304

New Contributors
* galkleinman made their first contribution in https://github.com/BerriAI/litellm/pull/224
* ErikBjare made their first contribution in https://github.com/BerriAI/litellm/pull/222
* adriensas made their first contribution in https://github.com/BerriAI/litellm/pull/185
* nirga made their first contribution in https://github.com/BerriAI/litellm/pull/227
* estill01 made their first contribution in https://github.com/BerriAI/litellm/pull/240
* shauryr made their first contribution in https://github.com/BerriAI/litellm/pull/294

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v0.1.492...v0.1.574

What's Changed
* Fix ModelResponse typing by yujonglee in https://github.com/BerriAI/litellm/pull/144
* Fixing favicon path 142 by NANDINI-star in https://github.com/BerriAI/litellm/pull/152
* Added importlib, changed favicon, fixed __version__ by zakhar-kogan in https://github.com/BerriAI/litellm/pull/180
* added lunr search bar in docs by NANDINI-star in https://github.com/BerriAI/litellm/pull/187
* Support for LLMonitor - open-source observability & analytics by vincelwt in https://github.com/BerriAI/litellm/pull/181
* modified the image extension to .png by NANDINI-star in https://github.com/BerriAI/litellm/pull/189

New Contributors
* yujonglee made their first contribution in https://github.com/BerriAI/litellm/pull/144
* NANDINI-star made their first contribution in https://github.com/BerriAI/litellm/pull/152
* vincelwt made their first contribution in https://github.com/BerriAI/litellm/pull/181

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v0.1.387...v0.1.492