 Taneem Ibrahim
|
fdab2b10bc
|
[ModelRunner v2] Support Transformers pooling model (#52425)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-16 15:25:49 -04:00 |
|
|
|
ef43e3101b
|
[ROCm][DSV4][Perf] Optimize Triton sparse-MLA decode on gfx950 (#52212)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cursor Grok 4.6 <cursoragent@cursor.com>
|
2026-08-16 12:16:46 -07:00 |
|
|
Taneem IbrahimandWentao Ye
|
1f0e0bf612
|
[Bugfix][Attention] Temporarily disable FA4 head-dim 256 (#52050)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-16 17:13:02 +00:00 |
|
|
Wentao Ye
|
7d7b6f26f4
|
[Refactor] Remove dead code for quantization (#52221)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-16 13:10:16 -04:00 |
|
|
akii96
|
6914d60b1e
|
[ROCm][Perf] gfx942: use FlyDSL fp8 MQA logits kernel (ROCm/aiter#3913) (#49544)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-08-16 16:50:31 +00:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
83f591d7f6
|
[Perf][DSV4] Optimize global top-k index kernel with compile-time constants (#51967)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-16 23:24:14 +08:00 |
|
|
|
9409f59e09
|
[Core] Add CuMemAllocator.discard() for tag-selective GPU memory release (#52514)
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: AlanFokCo <alanfok2868@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-16 23:15:14 +08:00 |
|
|
Shantipriya Parida
|
fe1c317157
|
[Bugfix][ROCm] Skip FP8 MLA prefill PS-metadata build for chunked-context batches (#52356)
Signed-off-by: Shantipriya Parida <shantipriya.parida@amd.com>
|
2026-08-16 13:21:31 +00:00 |
|
|
Chauncey
|
836aac92ff
|
[Perf][DSV4] Optimize sparse top-k metadata kernels for higher prefill throughput (#52084)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-16 21:15:47 +08:00 |
|
|
|
4d2a68d64d
|
[Bugfix][Spec Decode][Structured Output] DSpark: fix the grammar bitmask mapping when the draft budget is zero (#52436)
Signed-off-by: oops-oom <73481342@qq.com>
Co-authored-by: oops-oom <73481342@qq.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-16 11:09:23 +00:00 |
|
|
Chauncey
|
84530eb235
|
[Bugfix][Multimodal] Keep Gemma 4 video frame counts on CPU (#52441)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-16 09:17:04 +00:00 |
|
|
|
1b079c40ff
|
[Bugfix][Model Runner V2][Spec Decode] Fix off-by-one in bad_words draft-prefix matching (#52311)
Signed-off-by: jyan <r_02213@sjtu.edu.cn>
Co-authored-by: jyan <r_02213@sjtu.edu.cn>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-16 09:02:20 +00:00 |
|
|
Do_it_now_!
|
70aaec832b
|
[Bugfix][Anthropic] Return 4xx for client-caused errors in /v1/messages (#52246)
Signed-off-by: Do_it_now_! <lizhengcheng233@gmail.com>
|
2026-08-16 01:05:17 -07:00 |
|
|
Jeffrey WangandClaude Opus 5
|
41f12a0daf
|
[Bugfix] Raise VLLMValidationError from structured output validators (#52394)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-16 01:04:51 -07:00 |
|
|
Nick Hill
|
8efa13b700
|
[Bugfix] Pick the DeepSeek V4 eager cudagraph region per model runner (#52401)
|
2026-08-15 21:04:08 -07:00 |
|
|
mispa-ms
|
6593754e61
|
[Bugfix][Spec Decode] Keep EAGLE cache registration on the partial-hash-hit path (#52419)
|
2026-08-15 21:03:53 -07:00 |
|
|
|
edd4c8176c
|
[Bugfix][DSv4] Revert adaptive C128A metadata packing (#51318)
Signed-off-by: tobymao <toby.mao@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-15 18:39:23 -07:00 |
|
|
|
fa9d67f782
|
[EC Connector] Added Build Connector Worker Meta for EC Connector (#49585)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Signed-off-by: omerpaz95 <73347585+omerpaz95@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-15 15:40:38 -07:00 |
|
|
Henry Su
|
c94cdd0ae0
|
[Bugfix][Sampling] Clear empty side on thinking-budget asymmetric SWAP (#49613)
Signed-off-by: Henry Su <henrysu4707@gmail.com>
|
2026-08-15 21:13:02 +00:00 |
|
|
UranusandClaude
|
ed0f4750f8
|
[Bugfix][Model] Kimi-K3 MegaMoE: pass situ_beta/situ_linear_beta to fp8_fp4_mega_moe (#52445)
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-15 11:59:22 -07:00 |
|
|
Shane Widanagama
|
d4801990a4
|
[CI/Build] Add warning for unsupported global PTX architecture requests in... (#51901)
|
2026-08-15 07:01:52 -07:00 |
|
|
Gabriel Wu
|
97388c44f9
|
[Bugfix] Make DSV4 sparse MLA work end-to-end for plain decode, MTP, and DSpark (#51538)
|
2026-08-15 07:01:32 -07:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ac2ae8798c
|
[Frontend] Support count_reasoning_tokens in the Streaming Parser Engine (#45802)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-15 06:51:14 -07:00 |
|
|
Cyrus Leung
|
5cecfc0137
|
[Bugfix] Fix modelscope usage (#52431)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-15 02:40:24 -07:00 |
|
|
Biswa Panda
|
42156466db
|
[Rust Frontend][gRPC] Preserve skip_special_tokens decoding option (#52384)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
|
2026-08-15 08:54:58 +00:00 |
|
|
Andreas Karatzas
|
44fc57d7b7
|
[ROCm][CI] Select CPU platform for native no-GPU jobs (#49515)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-14 23:30:56 -07:00 |
|
|
Yongye Zhu
|
acb0f1dcdb
|
[Bugfix][Spec Decode] DSpark: inherit the target's attention backend when the speculative config names none (#52288)
|
2026-08-15 09:32:59 +08:00 |
|
|
Nick HillandClaude Opus 4.8
|
615d4cfade
|
[Core] Check for GPU<->CPU syncs during CI (#43107)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-14 17:42:05 -07:00 |
|
|
|
7b544ecb52
|
[Spec Decode][Perf] Fuse the MTP trailing all-reduce; local-argmax draft tokens (#49793)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-14 17:07:07 -07:00 |
|
|
Nick Hill
|
d6f17f3d53
|
[MRV2] Support attention-free models (#52374)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-14 23:54:50 +00:00 |
|
|
Rohan Potdar
|
9df9b0b0a1
|
[ROCm]: Drop pybind11 from Dockerfile.rocm to prevent version mismatch (#52400)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
|
2026-08-14 23:50:23 +00:00 |
|
|
Kevin H. Luu
|
bb4b448f98
|
[CI] Shard Humming H100 eval (#52326)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-14 15:12:02 -07:00 |
|
|
Kevin H. Luu
|
81e81dac1f
|
[CI] Shard MoE refactor B200 eval (#52327)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-14 15:11:55 -07:00 |
|
|
Kevin H. Luu
|
694db075f8
|
[CI] Shard multimodal extended generation 2 (#52323)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-14 15:11:48 -07:00 |
|
|
Kevin H. Luu
|
549cef0b0b
|
[CI] Shard extended pooling model tests (#52322)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-08-14 15:11:41 -07:00 |
|
|
Kevin H. Luu
|
d87ef456ab
|
[CI] Shard Quantization job into 4 parallel shards (≤30 min target) (#52328)
|
2026-08-14 15:11:32 -07:00 |
|
|
Guanxin LiandClaude Opus 5
|
925ea7e60f
|
[CI][Test] Seed the DeepEP v2 MoE workers, not just the parent (#50589)
Signed-off-by: Guanxin Li <guanxinl@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-14 16:01:24 -04:00 |
|
|
sroberts-amdandStacy Roberts
|
c794754062
|
[ROCm]Remove special-case SiTU support model-specific gating (#50597)
Signed-off-by: Stacy Roberts <sroberts@amd.com>
Signed-off-by: Stacy Roberts <robers23@utexas.edu>
Co-authored-by: Stacy Roberts <robers23@utexas.edu>
|
2026-08-14 13:38:04 -05:00 |
|
|
Connor CarpenterandNick Hill
|
f473870ecf
|
[Rust Frontend][gRPC] Add RL lifecycle control (#51316)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-14 11:32:39 -07:00 |
|
|
Nick Hill
|
3e3ceb1961
|
[Perf] Avoid more GPU<->CPU syncs in multimodal encoders (#52369)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-14 10:40:14 -07:00 |
|
|
James E T SmithandAndreas Karatzas
|
9b0ab5dd53
|
[ROCm][AMD] Enable preshuffled sparse indexing for 16-token blocks (#51216)
Signed-off-by: jamesETsmith <james.smith9113@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-14 12:38:14 -05:00 |
|
|
stefankoncarevic
|
83ded8d839
|
[Test][LoRA] Speed up the LoRA test job (#52331)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-14 12:08:41 -05:00 |
|
|
shanjiaz
|
e078a2238a
|
[Bugfix] Widen flashinfer.comm import guard so a failed import doesn't abort engine startup (#52241)
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
|
2026-08-14 16:27:24 +00:00 |
|
|
Rahul ChalamalaandJanelle Cai
|
03a8d0b1ed
|
[Model][Spec Decode] Tap the pre-norm AttnRes mixture as the Kimi K3 DFlash aux state (#50487)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
|
2026-08-14 09:03:42 -07:00 |
|
|
wangxiyuanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
cdc4824a21
|
[Misc] Remove override_attention_dtype (#48684)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-14 11:15:43 -04:00 |
|
|
Qiming ZhangandAndreas Karatzas
|
1f7427bc0a
|
[UT][XPU] fix b12x UT (#52265)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-14 09:49:47 -04:00 |
|
|
Lucas WilkinsonandClaude
|
57bd0ed441
|
[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-14 09:47:55 -04:00 |
|
|
Zhuobin Huangandnodeeeeee
|
63a9a5010a
|
[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)
Signed-off-by: zobinHuang <zobin1999@gmail.com>
Co-authored-by: nodeeeeee <zhangkai.nodeee@gmail.com>
|
2026-08-14 10:09:51 +00:00 |
|
|
iwannagotobedandChauncey
|
aa31003573
|
[Bugfix][Helm] Fix chart resource references (#51664)
Signed-off-by: iwannagotobed <us990704@yonsei.ac.kr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-08-14 17:47:42 +08:00 |
|
|
Jee Jee Li
|
69e0e58da1
|
[Doc] Update model support information (#52289)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-14 09:47:30 +00:00 |
|