Litellm

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.41...1.34.40.dev1

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 77 | 81.173657764966 | 1.5063339924614734 | 0.0 | 451 | 0 | 71.93741999998338 | 766.846145000045 |
| /health/liveliness | Passed ✅ | 62 | 65.36667029825317 | 15.487518232913198 | 0.003339986679515462 | 4637 | 1 | 59.801646999972036 | 1681.3968060000093 |
| /health/readiness | Passed ✅ | 62 | 66.13317987362252 | 15.460798339477074 | 0.0 | 4629 | 0 | 59.8357880000151 | 1439.9600270000406 |
| Aggregated | Passed ✅ | 62 | 66.4654790017493 | 32.45465056485175 | 0.003339986679515462 | 9717 | 1 | 59.801646999972036 | 1681.3968060000093 |

🚨 UI Runtime error. Wait till next release to upgrade, if you use LiteLLM UI

What's Changed
* Added support for newly released `gpt-4-turbo-2024-04-09` and `gpt-4-turbo` by ventz in https://github.com/BerriAI/litellm/pull/2920
* feat: add gemini-1.5-pro-preview-0409 to vertex ai by cheahjs in https://github.com/BerriAI/litellm/pull/2914
* feat(gemini.py): support google-genai system instruction by krrishdholakia in https://github.com/BerriAI/litellm/pull/2925
* Gemini pro 1.5 model is now named correctly for AI Studio. by jpshackelford in https://github.com/BerriAI/litellm/pull/2926
* Clark/tpm rpm docs by CLARKBENHAM in https://github.com/BerriAI/litellm/pull/2909
* fix(main.py): handle translating text completion openai to chat completion for async requests by krrishdholakia in https://github.com/BerriAI/litellm/pull/2924

New Contributors
* ventz made their first contribution in https://github.com/BerriAI/litellm/pull/2920
* jpshackelford made their first contribution in https://github.com/BerriAI/litellm/pull/2926

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.38...v1.34.39

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 40 | 43.746598010869974 | 1.5368923320897772 | 0.0 | 460 | 0 | 35.04595399999744 | 468.7995090000072 |
| /health/liveliness | Passed ✅ | 25 | 27.79845553243649 | 15.398992953482136 | 0.0 | 4609 | 0 | 23.410484999999426 | 1118.1426470000133 |
| /health/readiness | Passed ✅ | 25 | 27.354294543427137 | 15.579410748988327 | 0.0 | 4663 | 0 | 23.39587599999504 | 1305.677650000007 |
| Aggregated | Passed ✅ | 25 | 28.33945664714355 | 32.515296034560244 | 0.0 | 9732 | 0 | 23.39587599999504 | 1305.677650000007 |

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.40...1.34.39.dev1

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 80 | 82.05284844933918 | 1.5163375404027182 | 0.0 | 454 | 0 | 74.30707200001052 | 202.55287200001248 |
| /health/liveliness | Passed ✅ | 65 | 68.21450552862387 | 15.460631001154587 | 0.0 | 4629 | 0 | 63.24671999999509 | 1301.691882 |
| /health/readiness | Passed ✅ | 65 | 67.96381959687382 | 15.170055305086224 | 0.0 | 4542 | 0 | 63.33682399997542 | 1160.9531469999865 |
| Aggregated | Passed ✅ | 65 | 68.74894627501315 | 32.14702384664353 | 0.0 | 9625 | 0 | 63.24671999999509 | 1301.691882 |

What's Changed
* [New Models] Add Voyage 2 embedding models by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2913
* Fix issue 2832: Add protected_namespaces to Config class within utils.py, router.py and completion.py to avoid the warning message. by unclecode in https://github.com/BerriAI/litellm/pull/2893
* build(ui/admin.tsx): allow adding admins + upgrading viewer to admin by krrishdholakia in https://github.com/BerriAI/litellm/pull/2919

New Contributors
* unclecode made their first contribution in https://github.com/BerriAI/litellm/pull/2893

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.37.dev1...v1.34.38

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 80 | 85.66869084033509 | 1.5897029409256755 | 0.003339712060768226 | 476 | 1 | 74.68973499999265 | 1233.7370480000232 |
| /health/liveliness | Passed ✅ | 66 | 68.48476484741958 | 15.212388436799268 | 0.003339712060768226 | 4555 | 1 | 63.37483100003283 | 1288.7348689999953 |
| /health/readiness | Passed ✅ | 66 | 68.19508600873709 | 15.289201814196938 | 0.010019136182304678 | 4578 | 3 | 63.61198400009016 | 1516.8382620000216 |
| Aggregated | Passed ✅ | 66 | 69.1979919313138 | 32.09129319192188 | 0.016698560303841127 | 9609 | 5 | 63.37483100003283 | 1516.8382620000216 |

What's Changed
* UI view set callbacks by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2902
* UI - add a set callbacks on Admin UI (Backend Changes) by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2901
* ui - add langfuse modal by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2903
* UI add slack alerting by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2905
* fix(proxy_server.py): allow mapping a user to an org by krrishdholakia in https://github.com/BerriAI/litellm/pull/2907
* fix datetime json serialize error in langsmith integration by garfeildma in https://github.com/BerriAI/litellm/pull/2906


**Full Changelog**: https://github.com/BerriAI/litellm/compare/1.34.35-stable...v1.34.37

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 77 | 89.62353590672491 | 1.5398411467131836 | 0.0033402194071869493 | 461 | 1 | 72.80556299997443 | 1240.0245009999935 |
| /health/liveliness | Passed ✅ | 62 | 65.6125592886622 | 15.054368868191581 | 0.0 | 4507 | 0 | 59.63998400000037 | 1280.983823999975 |
| /health/readiness | Passed ✅ | 62 | 65.78019976622576 | 15.64558770326367 | 0.0 | 4684 | 0 | 59.52258299998903 | 1236.3295840000035 |
| Aggregated | Passed ✅ | 62 | 66.8407283953587 | 32.23979771816843 | 0.0033402194071869493 | 9652 | 1 | 59.52258299998903 | 1280.983823999975 |

What's Changed
* [UI] QA Improvements to adding callbacks, models by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2912


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.37...v1.34.37.dev1

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 77 | 80.51407646458344 | 1.603350507385046 | 0.0 | 480 | 0 | 71.92962899995337 | 539.6768960000031 |
| /health/liveliness | Passed ✅ | 62 | 64.73594564058693 | 15.241850760829095 | 0.0066806271141043585 | 4563 | 2 | 59.78436700002021 | 1552.9094980000195 |
| /health/readiness | Passed ✅ | 62 | 63.946665819295596 | 15.268573269285511 | 0.0033403135570521793 | 4571 | 1 | 59.93750400000408 | 1245.6787830000167 |
| Aggregated | Passed ✅ | 62 | 65.14843833170362 | 32.11377453749965 | 0.010020940671156537 | 9614 | 3 | 59.78436700002021 | 1552.9094980000195 |