 Chauncey
|
84530eb235
|
[Bugfix][Multimodal] Keep Gemma 4 video frame counts on CPU (#52441)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-16 09:17:04 +00:00 |
|
|
|
1b079c40ff
|
[Bugfix][Model Runner V2][Spec Decode] Fix off-by-one in bad_words draft-prefix matching (#52311)
Signed-off-by: jyan <r_02213@sjtu.edu.cn>
Co-authored-by: jyan <r_02213@sjtu.edu.cn>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-16 09:02:20 +00:00 |
|
|
Do_it_now_!
|
70aaec832b
|
[Bugfix][Anthropic] Return 4xx for client-caused errors in /v1/messages (#52246)
Signed-off-by: Do_it_now_! <lizhengcheng233@gmail.com>
|
2026-08-16 01:05:17 -07:00 |
|
|
Jeffrey WangandClaude Opus 5
|
41f12a0daf
|
[Bugfix] Raise VLLMValidationError from structured output validators (#52394)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-16 01:04:51 -07:00 |
|
|
Nick Hill
|
8efa13b700
|
[Bugfix] Pick the DeepSeek V4 eager cudagraph region per model runner (#52401)
|
2026-08-15 21:04:08 -07:00 |
|
|
mispa-ms
|
6593754e61
|
[Bugfix][Spec Decode] Keep EAGLE cache registration on the partial-hash-hit path (#52419)
|
2026-08-15 21:03:53 -07:00 |
|
|
|
edd4c8176c
|
[Bugfix][DSv4] Revert adaptive C128A metadata packing (#51318)
Signed-off-by: tobymao <toby.mao@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-15 18:39:23 -07:00 |
|
|
|
fa9d67f782
|
[EC Connector] Added Build Connector Worker Meta for EC Connector (#49585)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Signed-off-by: omerpaz95 <73347585+omerpaz95@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-15 15:40:38 -07:00 |
|
|
Henry Su
|
c94cdd0ae0
|
[Bugfix][Sampling] Clear empty side on thinking-budget asymmetric SWAP (#49613)
Signed-off-by: Henry Su <henrysu4707@gmail.com>
|
2026-08-15 21:13:02 +00:00 |
|
|
UranusandClaude
|
ed0f4750f8
|
[Bugfix][Model] Kimi-K3 MegaMoE: pass situ_beta/situ_linear_beta to fp8_fp4_mega_moe (#52445)
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-15 11:59:22 -07:00 |
|
|
Shane Widanagama
|
d4801990a4
|
[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901)
|
2026-08-15 07:01:52 -07:00 |
|
|
Gabriel Wu
|
97388c44f9
|
[Bugfix] Make DSV4 sparse MLA work end-to-end for plain decode, MTP, and DSpark (#51538)
|
2026-08-15 07:01:32 -07:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ac2ae8798c
|
[Frontend] Support count_reasoning_tokens in the Streaming Parser Engine (#45802)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-15 06:51:14 -07:00 |
|
|
Cyrus Leung
|
5cecfc0137
|
[Bugfix] Fix modelscope usage (#52431)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-15 02:40:24 -07:00 |
|
|
Biswa Panda
|
42156466db
|
[Rust Frontend][gRPC] Preserve skip_special_tokens decoding option (#52384)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
|
2026-08-15 08:54:58 +00:00 |
|
|
Andreas Karatzas
|
44fc57d7b7
|
[ROCm][CI] Select CPU platform for native no-GPU jobs (#49515)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-14 23:30:56 -07:00 |
|
|
Yongye Zhu
|
acb0f1dcdb
|
[Bugfix][Spec Decode] DSpark: inherit the target's attention backend when the speculative config names none (#52288)
|
2026-08-15 09:32:59 +08:00 |
|
|
Nick HillandClaude Opus 4.8
|
615d4cfade
|
[Core] Check for GPU<->CPU syncs during CI (#43107)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-14 17:42:05 -07:00 |
|
|
|
7b544ecb52
|
[Spec Decode][Perf] Fuse the MTP trailing all-reduce; local-argmax draft tokens (#49793)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-14 17:07:07 -07:00 |
|
|
Nick Hill
|
d6f17f3d53
|
[MRV2] Support attention-free models (#52374)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-14 23:54:50 +00:00 |
|
|
Rohan Potdar
|
9df9b0b0a1
|
[ROCm]: Drop pybind11 from Dockerfile.rocm to prevent version mismatch (#52400)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
|
2026-08-14 23:50:23 +00:00 |
|
|
Kevin H. Luu
|
bb4b448f98
|
[CI] Shard Humming H100 eval (#52326)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-14 15:12:02 -07:00 |
|
|
Kevin H. Luu
|
81e81dac1f
|
[CI] Shard MoE refactor B200 eval (#52327)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-14 15:11:55 -07:00 |
|
|
Kevin H. Luu
|
694db075f8
|
[CI] Shard multimodal extended generation 2 (#52323)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-14 15:11:48 -07:00 |
|
|
Kevin H. Luu
|
549cef0b0b
|
[CI] Shard extended pooling model tests (#52322)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-08-14 15:11:41 -07:00 |
|
|
Kevin H. Luu
|
d87ef456ab
|
[CI] Shard Quantization job into 4 parallel shards (≤30 min target) (#52328)
|
2026-08-14 15:11:32 -07:00 |
|
|
Guanxin LiandClaude Opus 5
|
925ea7e60f
|
[CI][Test] Seed the DeepEP v2 MoE workers, not just the parent (#50589)
Signed-off-by: Guanxin Li <guanxinl@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-14 16:01:24 -04:00 |
|
|
sroberts-amdandStacy Roberts
|
c794754062
|
[ROCm]Remove special-case SiTU support model-specific gating (#50597)
Signed-off-by: Stacy Roberts <sroberts@amd.com>
Signed-off-by: Stacy Roberts <robers23@utexas.edu>
Co-authored-by: Stacy Roberts <robers23@utexas.edu>
|
2026-08-14 13:38:04 -05:00 |
|
|
Connor CarpenterandNick Hill
|
f473870ecf
|
[Rust Frontend][gRPC] Add RL lifecycle control (#51316)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-14 11:32:39 -07:00 |
|
|
Nick Hill
|
3e3ceb1961
|
[Perf] Avoid more GPU<->CPU syncs in multimodal encoders (#52369)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-14 10:40:14 -07:00 |
|
|
James E T SmithandAndreas Karatzas
|
9b0ab5dd53
|
[ROCm][AMD] Enable preshuffled sparse indexing for 16-token blocks (#51216)
Signed-off-by: jamesETsmith <james.smith9113@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-14 12:38:14 -05:00 |
|
|
stefankoncarevic
|
83ded8d839
|
[Test][LoRA] Speed up the LoRA test job (#52331)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-14 12:08:41 -05:00 |
|
|
shanjiaz
|
e078a2238a
|
[Bugfix] Widen flashinfer.comm import guard so a failed import doesn't abort engine startup (#52241)
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
|
2026-08-14 16:27:24 +00:00 |
|
|
Rahul ChalamalaandJanelle Cai
|
03a8d0b1ed
|
[Model][Spec Decode] Tap the pre-norm AttnRes mixture as the Kimi K3 DFlash aux state (#50487)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
|
2026-08-14 09:03:42 -07:00 |
|
|
wangxiyuanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
cdc4824a21
|
[Misc] Remove override_attention_dtype (#48684)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-14 11:15:43 -04:00 |
|
|
Qiming ZhangandAndreas Karatzas
|
1f7427bc0a
|
[UT][XPU] fix b12x UT (#52265)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-14 09:49:47 -04:00 |
|
|
Lucas WilkinsonandClaude
|
57bd0ed441
|
[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-14 09:47:55 -04:00 |
|
|
Zhuobin Huangandnodeeeeee
|
63a9a5010a
|
[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)
Signed-off-by: zobinHuang <zobin1999@gmail.com>
Co-authored-by: nodeeeeee <zhangkai.nodeee@gmail.com>
|
2026-08-14 10:09:51 +00:00 |
|
|
iwannagotobedandChauncey
|
aa31003573
|
[Bugfix][Helm] Fix chart resource references (#51664)
Signed-off-by: iwannagotobed <us990704@yonsei.ac.kr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-08-14 17:47:42 +08:00 |
|
|
Jee Jee Li
|
69e0e58da1
|
[Doc] Update model support information (#52289)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-14 09:47:30 +00:00 |
|
|
bastefaniak
|
20405bfb15
|
[Bugfix] Fix Cosmos3-Edge processor after transformers 5.15 release (#51989)
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
|
2026-08-14 10:46:46 +01:00 |
|
|
Isotr0pyandOpenAI Codex
|
66728feb1f
|
[MRV2][Multimodal] Enable encoder cuda graph for model runner v2 (#49852)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-14 09:33:21 +00:00 |
|
|
wang.yuqi
|
b8165e5e58
|
[Frontend] Consolidate entrypoint exception handler (#52261)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-14 09:27:24 +00:00 |
|
|
Fangchen LiandClaude Opus 5
|
103c419f04
|
[Perf][Frontend] Vectorize Cohere binary embedding bit-packing (#52277)
Signed-off-by: Fangchen Li <fangchen.li@outlook.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-14 09:15:59 +00:00 |
|
|
Kunshang Ji
|
624999aae5
|
[XPU]bump up vllm_xpu_kernels to 0.1.13.2 (#52138)
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-14 17:01:37 +08:00 |
|
|
YiSheng5andKunshang Ji
|
3c8676aebb
|
[PP][XPU]Overlap async-scheduling PP sampled-token broadcast with compute (#51650)
Signed-off-by: yisheng <yi.sheng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-14 17:00:23 +08:00 |
|
|
Lucas Wilkinson
|
d4c24e6f5d
|
[CI] Increase extended generation test timeout (#52252)
|
2026-08-14 04:23:51 -04:00 |
|
|
ccaadaroandLi, Jiang <jiang1.li@intel.com>
|
bda4c3e8ee
|
[CPU] Fold the MXFP4 block scale in 2 instructions instead of 4 (#51583)
Signed-off-by: ccaadaro <ccanadar@unex.es>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-14 08:19:21 +00:00 |
|
|
Kunshang Ji
|
8e6d8e4f6a
|
[XPU][CI/Release][3/N] Add xpu wheel release to release pipeline (#52108)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
|
2026-08-14 14:00:17 +08:00 |
|
|
velonica0andLi, Jiang <jiang1.li@intel.com>
|
ac7509e2b1
|
[Bugfix][CPU][RISC-V] Fix build: make FP32Vec copy constructors non-explicit (#51099)
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-14 04:59:01 +00:00 |
|