 waizuichougou
|
32601ef7a1
|
[Perf][Multimodal] Avoid duplicate text embedding in Qwen2.5-Omni (#55415)
Signed-off-by: waizuichougou <2082431897@qq.com>
|
2026-09-05 06:39:32 +00:00 |
|
|
|
d87a440f88
|
[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514)
Signed-off-by: Yongqin Wang <yongqinwang@roblox.com>
Co-authored-by: Cursor <noreply@cursor.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-05 11:45:34 +08:00 |
|
|
Wei ZhaoandOpenAI Codex
|
16328c7a77
|
[Perf] Kimi K3 nvfp4 Align in_proj weights by 128 to avoid elementwise copy (#55242)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 10:46:47 +08:00 |
|
|
|
385ba6b5b0
|
[Bugfix][Quantization] Register Quark per-block FP8 scales as weight_scale (#54770)
Signed-off-by: jimmy-adams <41593649+jimmy-adams@users.noreply.github.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-05 10:44:24 +08:00 |
|
|
Nick Hill
|
8277c42e4c
|
[Perf] Ensure async h2d copies are pinned in more places (#55202)
|
2026-09-04 17:17:01 -07:00 |
|
|
Misha Goin
|
8f269a93bb
|
Revert "[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases" (#55392)
|
2026-09-04 14:45:24 -07:00 |
|
|
|
3f41d102c5
|
[1/2][Model Runner V2] DBO support, eager mode (#50945)
Signed-off-by: specture724 <specture724@gmail.com>
Signed-off-by: Anjie Hou <149605198+specture724@users.noreply.github.com>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-04 14:17:39 -07:00 |
|
|
Taneem IbrahimandHarry Mellor
|
784cac7c42
|
[Mypy] Fix mypy typing for P models (#54169)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-04 20:47:11 +00:00 |
|
|
|
5690b02c03
|
[Quantization] Support online quantization with partially pre-quantized checkpoints (#51392)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-04 11:46:06 -07:00 |
|
|
yzyyzyhhhandyaozhiyuan.666
|
1ff5edb023
|
[Bug-fix] Fix MoE fused sum row offsets (#50220)
Signed-off-by: yaozhiyuan.666 <yaozhiyuan.666@bytedance.com>
Co-authored-by: yaozhiyuan.666 <yaozhiyuan.666@bytedance.com>
|
2026-09-04 09:39:02 -07:00 |
|
|
Thomas OrtnerandHarry Mellor
|
8ad2076c4a
|
[Transformers backend] Find attention with a fuser and attach vLLM's layer to it (#54941)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-04 16:26:01 +00:00 |
|
|
|
f19431e5c8
|
[Bugfix][MoE] Allow TRTLLM FP8 block-scale MoE with SwiGLU clamp (#55069)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen524@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-04 08:34:21 -07:00 |
|
|
|
a69e75b9b6
|
Fast Start (#54921)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 06:32:06 -07:00 |
|
|
Thien TranandKimi
|
31a8a26662
|
[Qwen3.8-Flash-Next] Improve QSA sparse GQA for prefill and short-ctx decode (#54873)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-04 06:08:02 -07:00 |
|
|
Taneem Ibrahim
|
c615b1fd67
|
[Mypy] Fix mypy typing for L models (#54177)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-04 07:50:43 -04:00 |
|
|
Kunshang JiandGitHub Copilot
|
a8693df504
|
[SpecDecode]Fix spec decode warmup device selection (#55245)
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: GitHub Copilot <copilot@github.com>
|
2026-09-04 00:48:45 -07:00 |
|
|
Luyi Xiaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
8a728663c1
|
[Bugfix] Reject tokenizer-less Qwen VL processor init (#54886)
Signed-off-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-03 21:25:35 -07:00 |
|
|
|
579aef4e8d
|
[ROCm] Bump AITER to 0.1.21.post1 (#52826)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: fai <fangzhouai@gmail.com>
|
2026-09-03 16:28:40 -07:00 |
|
|
Fangzhou Ai
|
8bf39632b8
|
[ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845)
|
2026-09-03 10:42:25 -07:00 |
|
|
|
b7624069ff
|
[Fusion] Manual ActivationQuantFusionPass initial application (#51415)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
|
2026-09-03 13:37:31 -04:00 |
|
|
Bolin SunandClaude Fable 5
|
d410fc12f3
|
[Kernel] Enable Kimi-K3 SiTU on the CuteDSL MoE backend and the SM107 low-latency GEMM plan (#54606)
Signed-off-by: Bolin Sun <bolins@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-03 16:49:31 +00:00 |
|
|
Jiangyun Zhu
|
98ed0856f3
|
[Model] add GLM-5.3-Flash support (#53906)
|
2026-09-03 09:40:35 -07:00 |
|
|
SunandCodex
|
848ab131bc
|
[Perf] Accumulate Conformer attention scores with baddbmm (#55062)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-03 04:17:52 -07:00 |
|
|
Taneem Ibrahim
|
758c79e1c5
|
[Bugfix] Retain vocab embeddings during replacement (#55083)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-03 04:17:38 -07:00 |
|
|
djramic
|
0d3ede3e3b
|
[Bugfix][Model] Enable torch.compile for StableLM (#54969)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-03 03:21:54 -07:00 |
|
|
|
c21751c90b
|
[Kernel] Warm up Qwen GDN gated RMSNorm (#54251)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-03 18:19:48 +08:00 |
|
|
Bowen Tan
|
1f76efaa21
|
[Model] Add K2-Horizon model support (#55063)
|
2026-09-03 01:17:08 -07:00 |
|
|
|
5d09eb2cf3
|
[Bugfix][MoE] Preserve unquantized weight storage on ROCm (#46009)
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2c5.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Zhaodong Bing <zhaobing@smc300x-ccs-aus-gpuf2a0.prov.aus.ccs.cpe.ice.amd.com>
|
2026-09-03 11:06:09 +08:00 |
|
|
Kevin H. LuuandKimi Code
|
6c6376a09e
|
[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases (#55026)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-02 15:18:46 -07:00 |
|
|
|
a0d3e5c16e
|
[XPU] Add fused GemmaRMSNorm path for eager execution (#53678)
Signed-off-by: Huanxing <huanxing.shen@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-03 06:11:20 +08:00 |
|
|
Isotr0py
|
1356635d83
|
[New model][Multimodal] Add DeepSeek-V4-Flash-Vision-Exp support (#54566)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-02 11:09:09 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
d539de1c5d
|
[Docs] Add missing return annotations flagged by griffe (#54980)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-02 09:56:07 -07:00 |
|
|
Hung Hoang (黄兴）andCyrus Leung
|
3b45d053b4
|
[Bugfix][Model] Fix CohereASR streaming audio-token estimate (unit + subsampling) (#53829)
Signed-off-by: hungh <hungh@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-02 08:55:16 -07:00 |
|
|
|
ffe3bb3c72
|
[Hardware][XPU] Register matmul and linear batch-invariant kernels for XPU (#49209)
Signed-off-by: tzielinski-habana <tomasz.zielinski@intel.com>
Signed-off-by: Tomasz Zielinski <85164140+tzielinski-habana@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-02 13:31:38 +00:00 |
|
|
fxmarty-amd
|
7894394b07
|
[Online quantization] Add targeted online quantization configuration based on user patterns (#51285)
|
2026-09-02 08:55:15 -04:00 |
|
|
jackLeiandOpenAI Codex
|
584e8f0dda
|
[Model] Fix GLM-OCR MTP weight loading (#49869)
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-02 08:38:36 +00:00 |
|
|
Gabriel WuandKimi Code
|
396c5a5632
|
[Bugfix] Lazy-import FlashInfer PCIe IPC all-reduce in kernel_warmup (#54869)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-02 04:31:03 +00:00 |
|
|
|
ee3c00bbf4
|
[Performance] Register Triton W4A16 GEMM as a custom op (#51453)
Signed-off-by: giuseppegrossi <ggrossi@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-01 22:55:34 -05:00 |
|
|
Nick Hillandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a566ea7e8f
|
[Perf] Avoid more h2d copies from non-pinned tensors (#54660)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-01 20:37:09 -07:00 |
|
|
Yongye ZhuandOpenAI Codex
|
3ba9907a1d
|
[Kimi-K3] Overlap low-M TP8 KDA projections (#54697)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-02 03:35:28 +00:00 |
|
|
Divakar VermaandAndreas Karatzas
|
dbf1a044ea
|
[Bugfix] Fix ColQwen3.5 pooler projector initialization (#54847)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-02 10:35:43 +08:00 |
|
|
Thien Tran
|
003e34341a
|
[Qwen3.8-Flash-Next] Separate prefill and decode paths for QSA indexer (#54513)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-09-02 09:08:10 +08:00 |
|
|
mingg26andOpenAI Codex
|
259a209bfa
|
[Kimi-K3][Perf] Prefetch ll_bf16 router weights for M=1 (#53524)
Signed-off-by: ming <ming@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-01 21:40:19 +00:00 |
|
|
Micah Williamson
|
ce6a283c09
|
[Bugfix] Restore weight_dtype in QuarkW8A8Fp8MoEMethod to fix GPT-OSS FP8 MoE weight loading (#54824)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-09-01 16:08:11 -05:00 |
|
|
|
7a977c0699
|
[ModelOpt] Redesign the LinearMethod classes using the generic QuantKey-driven method (#49381)
Signed-off-by: Juhi Mittal <juhim@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-01 16:28:56 -04:00 |
|
|
stefankoncarevic
|
73723b707f
|
[ROCm][MoE] Fix gfx950 block scale swizzle for AITER Triton MXFP4 W4A16 (#54773)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-09-01 19:48:45 +00:00 |
|
|
Julien Debache
|
ab54f5bd83
|
[Chore] Remove redundant _pack_topk_ids_weights_kernel in TrtLLM NvFP4 MoE (#46872)
Signed-off-by: jdebache <jdebache@nvidia.com>
|
2026-09-01 15:30:11 -04:00 |
|
|
Wentao Ye
|
6c58595c2d
|
[Feature] Avoid flashinfer autotune each time when vllm source change (#54794)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-01 15:03:30 -04:00 |
|
|
|
2fe5cef35e
|
[Fix] Fix FSE compatibility detection for Quark-produced models (#54573)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-01 12:12:20 -05:00 |
|
|
Harry MellorandClaude Opus 5
|
f1e5fdd7f2
|
[Transformers backend] Replace vocab embeddings in recursive_replace (#54760)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-01 15:35:24 +00:00 |
|