Sglang

What's Changed
* Fix for T4 GPUs by Ying1123 in https://github.com/sgl-project/sglang/pull/16
* Gemini Backend by caoshiyi in https://github.com/sgl-project/sglang/pull/9
* Teak mem fraction by merrymercy in https://github.com/sgl-project/sglang/pull/20
* Add option to return metadata in async streaming by BabyChouSr in https://github.com/sgl-project/sglang/pull/18
* Expose more arguments to control the scheduling policy by merrymercy in https://github.com/sgl-project/sglang/pull/32
* Rename image_url to image_file by BabyChouSr in https://github.com/sgl-project/sglang/pull/15
* Improve docs by merrymercy in https://github.com/sgl-project/sglang/pull/17
* Improve docs & Rename Gemini -> VertexAI by merrymercy in https://github.com/sgl-project/sglang/pull/19
* Fix streaming by merrymercy in https://github.com/sgl-project/sglang/pull/30

New Contributors
* BabyChouSr made their first contribution in https://github.com/sgl-project/sglang/pull/15
* Ying1123 made their first contribution in https://github.com/sgl-project/sglang/pull/16
* caoshiyi made their first contribution in https://github.com/sgl-project/sglang/pull/9

**Full Changelog**: https://github.com/sgl-project/sglang/compare/v0.1.3...v0.1.5

* upgrade sgl-kernel 0.0.4.post3 by zhyncs in https://github.com/sgl-project/sglang/pull/4334
* Add INT8 support MTP NextN function by lambert0312 in https://github.com/sgl-project/sglang/pull/3911
* [Fix] fix _yarn_linear_ramp_mask with device parameter by Alcanderian in https://github.com/sgl-project/sglang/pull/4337
* remove the unused readline dependency from the Qwen2 model implementa… by yych0745 in https://github.com/sgl-project/sglang/pull/4340
* model: Support Janus-pro by mickqian in https://github.com/sgl-project/sglang/pull/3203
* Hierarchical Caching Refactoring and Fixing TP issue by xiezhq-hermann in https://github.com/sgl-project/sglang/pull/4082
* Support Blackwell Block Scale FP8 Gemm by elfiegg in https://github.com/sgl-project/sglang/pull/4278
* typo: Update http_server.py by WrRan in https://github.com/sgl-project/sglang/pull/4350
* Update nightly tests by merrymercy in https://github.com/sgl-project/sglang/pull/4352
* [Fix Doc.] Enable internal forwarding when starting the router by shizhediao in https://github.com/sgl-project/sglang/pull/4355
* Move output processing logic from scheduler.py into a separate file by merrymercy in https://github.com/sgl-project/sglang/pull/4354
* Fix scheduler proctitle suffix is ​​None by cnwenf in https://github.com/sgl-project/sglang/pull/4326
* feat: support ep size < 32 for sgl kernel by shuaills in https://github.com/sgl-project/sglang/pull/4348
* Fix per token fp8 quant precision by qingquansong in https://github.com/sgl-project/sglang/pull/4362
* Remove the choices in --speculative-eagle-topk argument by Achazwl in https://github.com/sgl-project/sglang/pull/4329
* docs: add parameter --log-requests-level by panpan0000 in https://github.com/sgl-project/sglang/pull/4335
* simple bugfix by WrRan in https://github.com/sgl-project/sglang/pull/4342
* Fix the doc of FR-Spec by Achazwl in https://github.com/sgl-project/sglang/pull/4295
* [Fix] Check the device backend before calling empty_cache function by cboss6 in https://github.com/sgl-project/sglang/pull/4212
* [FIX] fix incorrect output when enable both deepgemm and torch compile by AniZpZ in https://github.com/sgl-project/sglang/pull/4359
* add INT8 example into dsv3 README by laixinn in https://github.com/sgl-project/sglang/pull/4079
* Avoid duplicated request ids in batch APIs by tanconghui in https://github.com/sgl-project/sglang/pull/4026
* example: add async offline inference demo by kuizhiqing in https://github.com/sgl-project/sglang/pull/3961
* Add device detection and count functions to utils. by vshekhawat-hlab in https://github.com/sgl-project/sglang/pull/3962
* Move `aiohttp` into public dependencies by stevapple in https://github.com/sgl-project/sglang/pull/3980
* [tools] add fp8 max/min constant in utils by yiakwy-xpu-ml-framework-team in https://github.com/sgl-project/sglang/pull/3959
* HotFix: json serialization error when using OAI v1/batches endpoint with logprobs by dcfidalgo in https://github.com/sgl-project/sglang/pull/3896
* [docs] Update outdated description about `torch.compile` by junliu-mde in https://github.com/sgl-project/sglang/pull/3844
* [Doc] Fix typo in backend/sampling_params by yang-ybb in https://github.com/sgl-project/sglang/pull/3835
* Ensure Usage Data in Streaming Responses Aligns with vLLM’s Implementation by HermitSun in https://github.com/sgl-project/sglang/pull/3814
* [moe] fix: correct the cache size in the last chunk by ch-wan in https://github.com/sgl-project/sglang/pull/3679
* Support page size > 1 by merrymercy in https://github.com/sgl-project/sglang/pull/4356
* [XPU][CPU] Enable the native path of DeepSeek by airMeng in https://github.com/sgl-project/sglang/pull/4086
* Revert "[XPU][CPU] Enable the native path of DeepSeek" by merrymercy in https://github.com/sgl-project/sglang/pull/4367
* Update grafana.json by dblate in https://github.com/sgl-project/sglang/pull/4374
* fix accuracy issue by zhyncs in https://github.com/sgl-project/sglang/pull/4376
* bump 0.0.5 sgl-kernel by zhyncs in https://github.com/sgl-project/sglang/pull/4377
* upgrade sgl-kernel 0.0.5 by zhyncs in https://github.com/sgl-project/sglang/pull/4381
* chore: bump v0.4.4 by zhyncs in https://github.com/sgl-project/sglang/pull/4041

New Contributors
* yosoyjay made their first contribution in https://github.com/sgl-project/sglang/pull/3505
* FrankLeeeee made their first contribution in https://github.com/sgl-project/sglang/pull/3548
* Jiadalee made their first contribution in https://github.com/sgl-project/sglang/pull/3598
* whybeyoung made their first contribution in https://github.com/sgl-project/sglang/pull/3624
* fsx950223 made their first contribution in https://github.com/sgl-project/sglang/pull/3665
* panpan0000 made their first contribution in https://github.com/sgl-project/sglang/pull/3700
* ch-wan made their first contribution in https://github.com/sgl-project/sglang/pull/3692
* Chen-XiaoBing made their first contribution in https://github.com/sgl-project/sglang/pull/3705
* aoshen524 made their first contribution in https://github.com/sgl-project/sglang/pull/3652
* trayvonpan made their first contribution in https://github.com/sgl-project/sglang/pull/3588
* zixuanzhang226 made their first contribution in https://github.com/sgl-project/sglang/pull/3680
* andjsmi made their first contribution in https://github.com/sgl-project/sglang/pull/3740
* shahizat made their first contribution in https://github.com/sgl-project/sglang/pull/3761
* laixinn made their first contribution in https://github.com/sgl-project/sglang/pull/3730
* He1pa made their first contribution in https://github.com/sgl-project/sglang/pull/3799
* wilsonwu made their first contribution in https://github.com/sgl-project/sglang/pull/3741
* yuanheng-zhao made their first contribution in https://github.com/sgl-project/sglang/pull/3641
* nvcastet made their first contribution in https://github.com/sgl-project/sglang/pull/3709
* hcyz33 made their first contribution in https://github.com/sgl-project/sglang/pull/3841
* kebe7jun made their first contribution in https://github.com/sgl-project/sglang/pull/3519
* JC1DA made their first contribution in https://github.com/sgl-project/sglang/pull/3298
* Chi-Chu319 made their first contribution in https://github.com/sgl-project/sglang/pull/3898
* Qiaolin-Yu made their first contribution in https://github.com/sgl-project/sglang/pull/3897
* xqoasis made their first contribution in https://github.com/sgl-project/sglang/pull/3905
* KCFindstr made their first contribution in https://github.com/sgl-project/sglang/pull/3866
* elfiegg made their first contribution in https://github.com/sgl-project/sglang/pull/3966
* Zhou-sx made their first contribution in https://github.com/sgl-project/sglang/pull/3822
* xihuai18 made their first contribution in https://github.com/sgl-project/sglang/pull/4000
* cboss6 made their first contribution in https://github.com/sgl-project/sglang/pull/3954
* Xiuyu-Li made their first contribution in https://github.com/sgl-project/sglang/pull/3712
* sgjzfzzf made their first contribution in https://github.com/sgl-project/sglang/pull/3607
* zeroorhero made their first contribution in https://github.com/sgl-project/sglang/pull/3990
* samzong made their first contribution in https://github.com/sgl-project/sglang/pull/4101
* olliestanley made their first contribution in https://github.com/sgl-project/sglang/pull/4142
* windsonsea made their first contribution in https://github.com/sgl-project/sglang/pull/4162
* zcnrex made their first contribution in https://github.com/sgl-project/sglang/pull/4197
* brighill made their first contribution in https://github.com/sgl-project/sglang/pull/4181
* DavidChan0519 made their first contribution in https://github.com/sgl-project/sglang/pull/3958
* Young1993 made their first contribution in https://github.com/sgl-project/sglang/pull/4144
* lambert0312 made their first contribution in https://github.com/sgl-project/sglang/pull/4136
* yych0745 made their first contribution in https://github.com/sgl-project/sglang/pull/4287
* Ximingwang-09 made their first contribution in https://github.com/sgl-project/sglang/pull/4220
* Alcanderian made their first contribution in https://github.com/sgl-project/sglang/pull/4337
* shizhediao made their first contribution in https://github.com/sgl-project/sglang/pull/4355
* cnwenf made their first contribution in https://github.com/sgl-project/sglang/pull/4326
* qingquansong made their first contribution in https://github.com/sgl-project/sglang/pull/4362
* AniZpZ made their first contribution in https://github.com/sgl-project/sglang/pull/4359
* tanconghui made their first contribution in https://github.com/sgl-project/sglang/pull/4026
* kuizhiqing made their first contribution in https://github.com/sgl-project/sglang/pull/3961
* vshekhawat-hlab made their first contribution in https://github.com/sgl-project/sglang/pull/3962
* stevapple made their first contribution in https://github.com/sgl-project/sglang/pull/3980
* dcfidalgo made their first contribution in https://github.com/sgl-project/sglang/pull/3896
* junliu-mde made their first contribution in https://github.com/sgl-project/sglang/pull/3844
* yang-ybb made their first contribution in https://github.com/sgl-project/sglang/pull/3835
* airMeng made their first contribution in https://github.com/sgl-project/sglang/pull/4086
* dblate made their first contribution in https://github.com/sgl-project/sglang/pull/4374

**Full Changelog**: https://github.com/sgl-project/sglang/compare/v0.4.3...v0.4.4