Litellm

What's Changed
* (caching) improve s3 backend by Manouchehri in https://github.com/BerriAI/litellm/pull/1311
* Adds "pre-fill" support for Claude by spdustin in https://github.com/BerriAI/litellm/pull/1315

New Contributors
* spdustin made their first contribution in https://github.com/BerriAI/litellm/pull/1315

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.16.16...v1.16.17

What's Changed
* Litellm speed improvements by krrishdholakia in https://github.com/BerriAI/litellm/pull/1344


**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.16.15...v1.16.16

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.16.13...1.16.14

New providers
Xinference Embeddings: https://docs.litellm.ai/docs/providers/xinference
Voyage AI: https://docs.litellm.ai/docs/providers/voyage
Cloudflare AI workers: https://docs.litellm.ai/docs/providers/cloudflare_workers

Fixes:
AWS region name error when passing user bedrock client: https://github.com/BerriAI/litellm/issues/1292
Azure OpenAI models - use correct context window in `model_context_window_and_prices.json`
Fixes for Azure OpenAI + Streaming - counting prompt tokens correctly: https://github.com/BerriAI/litellm/issues/1264




What's Changed
* Update mistral.md by nanowell in https://github.com/BerriAI/litellm/pull/1157
* Use current Git folder for building Dockerfile by Manouchehri in https://github.com/BerriAI/litellm/pull/1076
* (fix) curl example on proxy/quick_start by ku-suke in https://github.com/BerriAI/litellm/pull/1163
* clarify the need to set an exporter by nirga in https://github.com/BerriAI/litellm/pull/1162
* Update mistral.md by ericmjl in https://github.com/BerriAI/litellm/pull/1174
* doc: updated langfuse ver 1.14 in pip install cmd by speedyankur in https://github.com/BerriAI/litellm/pull/1178
* Fix for issue that occured when proxying to ollama by clevcode in https://github.com/BerriAI/litellm/pull/1168
* Sample code to prevent logging API key in callback to Slack by navidre in https://github.com/BerriAI/litellm/pull/1185
* Add partial support of VertexAI safety settings by neubig in https://github.com/BerriAI/litellm/pull/1190
* docker build and push on release by Rested in https://github.com/BerriAI/litellm/pull/1197
* Add a default for safety settings in vertex AI by neubig in https://github.com/BerriAI/litellm/pull/1199
* Make vertex ai work with generate_content by neubig in https://github.com/BerriAI/litellm/pull/1213
* fix: success_callback logic for cost_tracking by sihyeonn in https://github.com/BerriAI/litellm/pull/1211
* Add aws_bedrock_runtime_endpoint support by Manouchehri in https://github.com/BerriAI/litellm/pull/1203
* fix least_busy router by updating min_traffic by AllentDan in https://github.com/BerriAI/litellm/pull/1195
* Improve langfuse integration by maxdeichmann in https://github.com/BerriAI/litellm/pull/1183
* usage_based_routing_fix by sumanth13131 in https://github.com/BerriAI/litellm/pull/1182
* add some GitHub workflows for flake8 and add black dependecy by bufferoverflow in https://github.com/BerriAI/litellm/pull/1223
* fix: helicone logging by evantancy in https://github.com/BerriAI/litellm/pull/1249
* update anyscale price link by prateeksachan in https://github.com/BerriAI/litellm/pull/1246
* Bump aiohttp from 3.8.4 to 3.9.0 by dependabot in https://github.com/BerriAI/litellm/pull/1180
* updated oobabooga to new api and support for embeddings by danikhan632 in https://github.com/BerriAI/litellm/pull/1248
* add support for mistral json mode via anyscale by marmikcfc in https://github.com/BerriAI/litellm/pull/1275
* Adds support for Vertex AI Unicorn by AshGreh in https://github.com/BerriAI/litellm/pull/1277
* fix typos & add missing names for azure models by fcakyon in https://github.com/BerriAI/litellm/pull/1290
* fix(proxy_server.py) Check when '_hidden_params' is None by asedmammad in https://github.com/BerriAI/litellm/pull/1300

New Contributors
* nanowell made their first contribution in https://github.com/BerriAI/litellm/pull/1157
* ku-suke made their first contribution in https://github.com/BerriAI/litellm/pull/1163
* ericmjl made their first contribution in https://github.com/BerriAI/litellm/pull/1174
* speedyankur made their first contribution in https://github.com/BerriAI/litellm/pull/1178
* clevcode made their first contribution in https://github.com/BerriAI/litellm/pull/1168
* navidre made their first contribution in https://github.com/BerriAI/litellm/pull/1185
* neubig made their first contribution in https://github.com/BerriAI/litellm/pull/1190
* Rested made their first contribution in https://github.com/BerriAI/litellm/pull/1197
* sihyeonn made their first contribution in https://github.com/BerriAI/litellm/pull/1211
* AllentDan made their first contribution in https://github.com/BerriAI/litellm/pull/1195
* sumanth13131 made their first contribution in https://github.com/BerriAI/litellm/pull/1182
* bufferoverflow made their first contribution in https://github.com/BerriAI/litellm/pull/1223
* evantancy made their first contribution in https://github.com/BerriAI/litellm/pull/1249
* prateeksachan made their first contribution in https://github.com/BerriAI/litellm/pull/1246
* danikhan632 made their first contribution in https://github.com/BerriAI/litellm/pull/1248
* marmikcfc made their first contribution in https://github.com/BerriAI/litellm/pull/1275
* AshGreh made their first contribution in https://github.com/BerriAI/litellm/pull/1277
* fcakyon made their first contribution in https://github.com/BerriAI/litellm/pull/1290
* asedmammad made their first contribution in https://github.com/BerriAI/litellm/pull/1300

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.15.0...1.16.12

**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.16.18...v1.16.6