Litellm

What's Changed
* (fix) show user their role when rejecting /team/new requests by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2729
* (feat) admin UI show models on team table by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2731
* (fix) UI - show user models when creating a key by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2732
* [FEAT] UI - view team alias when creating keys by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2734


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.8...v1.34.8.dev1

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Failed ❌ | 90 | 95.18066933991201 | 1.5231486048986131 | 0.5477990596565188 | 456 | 164 | 73.70403299995587 | 1227.018284000053 |
| /health/liveliness | Failed ❌ | 78 | 85.42985518872867 | 15.291610336021602 | 5.230812972086027 | 4578 | 1566 | 73.2654260000345 | 1335.0114459999531 |
| /health/readiness | Failed ❌ | 78 | 85.73612634587776 | 15.355074861225711 | 5.284256782784223 | 4597 | 1582 | 73.44564999999648 | 1525.4359269999895 |
| Aggregated | Failed ❌ | 78 | 86.03771519935606 | 32.16983380214593 | 11.06286881452677 | 9631 | 3312 | 73.2654260000345 | 1525.4359269999895 |

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.5...v1.34.6

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 39 | 43.494775435583094 | 1.633318116162535 | 0.0 | 489 | 0 | 34.97501599997577 | 1143.8180330000023 |
| /health/liveliness | Passed ✅ | 25 | 27.179221879552216 | 15.50149156873277 | 0.0 | 4641 | 0 | 23.14285799997151 | 989.7288989999993 |
| /health/readiness | Passed ✅ | 25 | 27.2245580989883 | 15.521532281814519 | 0.010020356540874447 | 4647 | 3 | 23.04965500002254 | 1015.2391109999712 |
| Aggregated | Passed ✅ | 25 | 28.016798140227166 | 32.656341966709824 | 0.010020356540874447 | 9777 | 3 | 23.04965500002254 | 1143.8180330000023 |

What's Changed
* fix(handle_jwt.py): enable team-based jwt-auth access by krrishdholakia in https://github.com/BerriAI/litellm/pull/2704
* (fix) Remove print statements from append_query_params by antoniomdk in https://github.com/BerriAI/litellm/pull/2697
* Fix Ollama embedding by onukura in https://github.com/BerriAI/litellm/pull/2675
* enable new `/team/disable` endpoint by krrishdholakia in https://github.com/BerriAI/litellm/pull/2705
* feat(llm_guard.py): enable key-specific llm guard check by krrishdholakia in https://github.com/BerriAI/litellm/pull/2706

New Contributors
* antoniomdk made their first contribution in https://github.com/BerriAI/litellm/pull/2697
* onukura made their first contribution in https://github.com/BerriAI/litellm/pull/2675

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.4.dev2...v1.34.5

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 80 | 91.09598086965796 | 1.5630632104195936 | 0.0 | 468 | 0 | 75.90920399997003 | 1370.1692500000036 |
| /health/liveliness | Passed ✅ | 66 | 68.46346034574393 | 15.340062661233318 | 0.0 | 4593 | 0 | 63.58234399999674 | 1380.5088000000012 |
| /health/readiness | Passed ✅ | 66 | 69.07605037803246 | 15.416879870292401 | 0.0 | 4616 | 0 | 63.49641600002087 | 1383.9997339999854 |
| Aggregated | Passed ✅ | 66 | 69.8502264090107 | 32.320005741945316 | 0.0 | 9677 | 0 | 63.49641600002087 | 1383.9997339999854 |

What's Changed
* [Feat] Proxy - /cache/flushall - delete all elements from cache by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2702
* (fix) Proxy fix cache control logic - fix `no-store` logic by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2696
* [Fix] remove litellm telemetry from proxy server by ishaan-jaff in https://github.com/BerriAI/litellm/pull/2703


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.34.4.dev1...v1.34.4.dev2

Load Test LiteLLM Proxy Results

| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| /chat/completions | Passed ✅ | 92 | 99.04622922560984 | 1.6434154232887563 | 0.0 | 492 | 0 | 86.46199399998977 | 496.77466399998593 |
| /health/liveliness | Passed ✅ | 78 | 85.9373431366058 | 15.037919178142237 | 0.0 | 4502 | 0 | 73.93678500000078 | 1486.8835759999683 |
| /health/readiness | Passed ✅ | 78 | 84.57857246170724 | 15.265057895182146 | 0.003340275250586903 | 4570 | 1 | 73.80300699998088 | 1357.8377890000013 |
| Aggregated | Passed ✅ | 79 | 85.96243619092432 | 31.94639249661314 | 0.003340275250586903 | 9564 | 1 | 73.80300699998088 | 1486.8835759999683 |