Litellm

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.40...1.34.39.dev1

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 80 | 82.05284844933918 | 1.5163375404027182 | 0.0 | 454 | 0 | 74.30707200001052 | 202.55287200001248 |
| /health/liveliness | Passed ✅ | 65 | 68.21450552862387 | 15.460631001154587 | 0.0 | 4629 | 0 | 63.24671999999509 | 1301.691882 |
| /health/readiness | Passed ✅ | 65 | 67.96381959687382 | 15.170055305086224 | 0.0 | 4542 | 0 | 63.33682399997542 | 1160.9531469999865 |
| Aggregated | Passed ✅ | 65 | 68.74894627501315 | 32.14702384664353 | 0.0 | 9625 | 0 | 63.24671999999509 | 1301.691882 |

What's Changed
* [New Models] Add Voyage 2 embedding models by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2913
* Fix issue 2832: Add protected_namespaces to Config class within utils.py, router.py and completion.py to avoid the warning message. by unclecode in https://github.com/BerriAI/litellm/pull/2893
* build(ui/admin.tsx): allow adding admins + upgrading viewer to admin by krrishdholakia in https://github.com/BerriAI/litellm/pull/2919

New Contributors
* unclecode made their first contribution in https://github.com/BerriAI/litellm/pull/2893

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.37.dev1...v1.34.38

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 80 | 85.66869084033509 | 1.5897029409256755 | 0.003339712060768226 | 476 | 1 | 74.68973499999265 | 1233.7370480000232 |
| /health/liveliness | Passed ✅ | 66 | 68.48476484741958 | 15.212388436799268 | 0.003339712060768226 | 4555 | 1 | 63.37483100003283 | 1288.7348689999953 |
| /health/readiness | Passed ✅ | 66 | 68.19508600873709 | 15.289201814196938 | 0.010019136182304678 | 4578 | 3 | 63.61198400009016 | 1516.8382620000216 |
| Aggregated | Passed ✅ | 66 | 69.1979919313138 | 32.09129319192188 | 0.016698560303841127 | 9609 | 5 | 63.37483100003283 | 1516.8382620000216 |

What's Changed
* UI view set callbacks by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2902
* UI - add a set callbacks on Admin UI (Backend Changes) by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2901
* ui - add langfuse modal by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2903
* UI add slack alerting by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2905
* fix(proxy_server.py): allow mapping a user to an org by krrishdholakia in https://github.com/BerriAI/litellm/pull/2907
* fix datetime json serialize error in langsmith integration by garfeildma in https://github.com/BerriAI/litellm/pull/2906


**Full Changelog**: https://github.com/BerriAI/litellm/compare/1.34.35-stable...v1.34.37

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 77 | 89.62353590672491 | 1.5398411467131836 | 0.0033402194071869493 | 461 | 1 | 72.80556299997443 | 1240.0245009999935 |
| /health/liveliness | Passed ✅ | 62 | 65.6125592886622 | 15.054368868191581 | 0.0 | 4507 | 0 | 59.63998400000037 | 1280.983823999975 |
| /health/readiness | Passed ✅ | 62 | 65.78019976622576 | 15.64558770326367 | 0.0 | 4684 | 0 | 59.52258299998903 | 1236.3295840000035 |
| Aggregated | Passed ✅ | 62 | 66.8407283953587 | 32.23979771816843 | 0.0033402194071869493 | 9652 | 1 | 59.52258299998903 | 1280.983823999975 |

What's Changed
* [UI] QA Improvements to adding callbacks, models by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2912


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.37...v1.34.37.dev1

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 77 | 80.51407646458344 | 1.603350507385046 | 0.0 | 480 | 0 | 71.92962899995337 | 539.6768960000031 |
| /health/liveliness | Passed ✅ | 62 | 64.73594564058693 | 15.241850760829095 | 0.0066806271141043585 | 4563 | 2 | 59.78436700002021 | 1552.9094980000195 |
| /health/readiness | Passed ✅ | 62 | 63.946665819295596 | 15.268573269285511 | 0.0033403135570521793 | 4571 | 1 | 59.93750400000408 | 1245.6787830000167 |
| Aggregated | Passed ✅ | 62 | 65.14843833170362 | 32.11377453749965 | 0.010020940671156537 | 9614 | 3 | 59.78436700002021 | 1552.9094980000195 |

What's Changed
* UI view set callbacks by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2902
* UI - add a set callbacks on Admin UI (Backend Changes) by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2901
* ui - add langfuse modal by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2903


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.35...v1.34.36



Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 56 | 58.54507118736945 | 1.5868012769087811 | 0.0 | 475 | 0 | 51.17489700000988 | 232.30003899999474 |
| /health/liveliness | Passed ✅ | 41 | 43.45138590815679 | 15.276720503797593 | 0.0 | 4573 | 0 | 38.588892000007036 | 1389.35812699998 |
| /health/readiness | Passed ✅ | 41 | 43.670719167233 | 15.721024861332051 | 0.0 | 4706 | 0 | 38.73415000003888 | 1430.30149599997 |
| Aggregated | Passed ✅ | 41 | 44.29223918115643 | 32.584546642038426 | 0.0 | 9754 | 0 | 38.588892000007036 | 1430.30149599997 |

What's Changed
* UI add slack alerting by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2905


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.36...v1.34.36.dev2