Litellm

LiteLLM Proxy UI 2.0 Launch
- Team members Create, delete proxy API Keys
- Team members sign in using Google SSO

Doc on Setting Up Admin UI: https://docs.litellm.ai/docs/proxy/ui
Link to Admin UI: https://litellm-dashboard.vercel.app/

UI Demo



* feat(main.py): support auto-infering mode if not set by krrishdholakia in https://github.com/BerriAI/litellm/pull/1652
* build(ui/litellm-dashboard): initial commit of litellm dashboard by krrishdholakia in https://github.com/BerriAI/litellm/pull/1649


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.20.1...v1.20.2

What's Changed
[Feat] add google login to litellm proxy by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1650
[BETA] SSO Google Login to your Proxy through LiteLLM UI, View, Manage Proxy API Keys

* Allow optional usage of the tls encryption for SMTP by scampion in https://github.com/BerriAI/litellm/pull/1648
**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.20.0...v1.20.1

What's Changed
* feat(proxy_server.py): save abbreviated key name if `allow_user_auth` enabled by krrishdholakia in https://github.com/BerriAI/litellm/pull/1642
* Litellm image gen cost tracking proxy by krrishdholakia in https://github.com/BerriAI/litellm/pull/1646


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.19.6...v1.20.0

What's Changed
* fix(utils.py): fix sagemaker cost tracking for streaming by krrishdholakia in https://github.com/BerriAI/litellm/pull/1618
* [FIX] print verbose take only one argument by scampion in https://github.com/BerriAI/litellm/pull/1630
* [Fix] SpendLogs stop logging model params by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1634
* [Feat] support `dimensions` OpenAI embedding param by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1635
* [FIX] Fixes Bug where Keys could cross their Key max_budget by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1640
* [Feat] Improve alert formats for Key budgets by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1644
* feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given by krrishdholakia in https://github.com/BerriAI/litellm/pull/1641

New Contributors
* scampion made their first contribution in https://github.com/BerriAI/litellm/pull/1630

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.19.4...v1.19.6

What's Changed
New OpenAI Models
`text-embedding-3-large`,
`text-embedding-3-small`
`gpt-4-0125-preview`
Usage - New Embedding models
python
response = litellm.embedding(
model="text-embedding-3-large",
input=["good morning from litellm", "this is another item"],
metadata={"anything": "good day"},
)

response = litellm.embedding(
model="text-embedding-3-small",
input=["good morning from litellm", "this is another item"],
metadata={"anything": "good day"},
)


Usage - `gpt-4-0125-preview`
python
response = litellm.completion(
model="gpt-4-0125-preview",
messages=messages,
max_tokens=10,
)


* fix(main.py): allow vertex ai project and location to be set in completion() call by krrishdholakia in https://github.com/BerriAI/litellm/pull/1623
* [UI] Admin UI improvements by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1625


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.19.3...v1.19.4

What's Changed
* [Feat] Alerts for Proxy Budgets by ishaan-jaff in https://github.com/BerriAI/litellm/pull/1615
Alerts for Proxy Budget

15% of Total proxy budget left
<img width="473" alt="Screenshot 2024-01-25 at 11 36 17 AM" src="https://github.com/BerriAI/litellm/assets/29436595/bd792cc1-6a53-41b8-9f03-6e8d82ef0970">

Proxy Total Budget Crossed
<img width="313" alt="Screenshot 2024-01-25 at 11 36 10 AM" src="https://github.com/BerriAI/litellm/assets/29436595/46ba1138-a5b4-47b2-8503-e600abe1478b">



**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.19.2...v1.19.3