Hemanth Acharya
fa4b70555b
[ROCm] Cast score correction bias tensor during model construction for DeepSeek/Kimi-K2 ( #39999 )
...
Signed-off-by: Hemanth Acharya <heachary@amd.com >
2026-04-24 09:02:12 +09:00
Jackmin801 and Robert Shaw
447c372ac5
[MoE] Move remaining PrepareAndFinalize to prepare finalize folder ( #39009 )
...
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com >
Signed-off-by: Jackmin801 <ongjackm@gmail.com >
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com >
2026-04-23 20:00:53 -04:00
Sophie du Couédic and gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
ff2c2bd80a
[Docs]Add documentation for bench serve visualization arguments ( #40539 )
...
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-04-23 15:48:29 -07:00
Matthew Bonanni
cde8d24710
[Spec Decode] Move SpecDecodeBaseProposer out of eagle.py ( #40732 )
...
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
2026-04-23 22:28:27 +00:00
bnellnm
4a6dd1c3cc
[Bugfix] Fix DeepSeek V2-Lite Accuracy drop ( #40673 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-04-23 18:11:37 -04:00
czhu-cohere and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
7ff65b1900
[Bugfix] Fix workspace resize leaking reserved GPU memory ( #39226 )
...
Signed-off-by: root <conway.zhu@cohere.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-23 20:50:05 +00:00
Johnny
7f95a66cbf
[NVIDIA] Add sm_110 (Jetson Thor) to CUDA 13.0 build targets ( #39233 )
2026-04-23 15:42:14 -04:00
1b1c01de39
[MoE] Move xpu moe to fused_moe/experts/ ( #40568 )
...
Signed-off-by: Jackmin801 <ongjackm@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-04-23 13:38:10 -04:00
e9ba519f45
[DP][Ray] Pin DP control bundle to same node as first GPU bundle ( #39167 )
...
Signed-off-by: Shahar Mor <smor@nvidia.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-23 17:21:13 +00:00
Or Ozeri
5ef33ab250
[kv_offload+HMA][10/N]: Support load with multiple KV groups ( #39402 )
...
Signed-off-by: Or Ozeri <oro@il.ibm.com >
2026-04-23 20:00:45 +03:00
bnellnm
1c2c1eb8b9
[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping ( #40671 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-04-23 11:22:34 -04:00
Nicolò Lucchesi
8824f50f1f
[CI] Split disaggregated tests into own test-area ( #40623 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-04-23 23:20:12 +08:00
pschlan-amd and TJian
0098db9ec1
[ROCm] Implement GPU-to-NUMA-node detection ( #40015 )
...
Signed-off-by: Patrick Schlangen <pschlan@amd.com >
Co-authored-by: TJian <tunjian.tan@embeddedllm.com >
2026-04-23 10:08:48 -05:00
Kunshang Ji
53ecc807c0
[XPU] Upgrade torch 2.11 for xpu ( #37947 )
...
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
2026-04-23 10:07:35 -05:00
b7a2605020
[Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware ( #40193 )
...
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com >
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-23 14:57:03 +00:00
stevenkuang and Jee Jee Li
d0009ddb0b
[Model] Support Hy3 preview ( #40681 )
...
Signed-off-by: stevenkuang <stevenkuang@tencent.com >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-04-23 22:08:26 +08:00
Richard Zou
424033f4fc
[Bugfix] Include inductor and functorch configs in compilation cache key ( #40627 )
...
Signed-off-by: Richard Zou <zou3519@gmail.com >
2026-04-23 09:52:59 -04:00
Isotr0py
da1e7311ca
[Misc] use model arch converter for bidi models identification ( #40701 )
...
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-04-23 13:42:52 +00:00
xiangdong
01cb41dcf5
[XPU][CI]Temporary disable 3 cases on Intel GPU in CI ( #40683 )
...
Signed-off-by: zengxian <xiangdong.zeng@intel.com >
2026-04-23 21:42:22 +08:00
2f314bc5e6
[CPU] Added faster exp routine for lower precision data types. ( #38112 )
...
Signed-off-by: Anna Mayne <anna.mayne@arm.com >
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
2026-04-23 13:14:44 +00:00
BadrBasowid
2196bac135
[Compilation] Refactor SiluMul activation+quant Fusion Pass ( #39684 )
...
Signed-off-by: BadrBasowid <badr.basowid@gmail.com >
2026-04-23 09:10:36 -04:00
Matthias Gehre
4b7869d6bc
[ROCm] Add gfx1102/gfx1103 support ( #40037 )
...
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com >
2026-04-23 01:32:04 -07:00
liuzhenwei
4a79262e0f
[UT][Hardware] let torchrun example tests use the default backend ( #39879 )
...
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
2026-04-23 16:22:28 +08:00
Shengqi Chen and Claude Opus 4.6
3ed5231c6a
[Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up stale build-args ( #39878 )
...
Signed-off-by: Shengqi Chen <harry-chen@outlook.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-23 15:51:28 +08:00
Nicolò Lucchesi
9c2492e501
[Misc] Support Human-readable (k/K/m/M..) json cli arg ( #40473 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-04-23 09:42:23 +02:00
Shanshan Shen
fe57be7809
[MM][CG] Support --enable-vit-cuda-graph option for VLM examples ( #40580 )
...
Signed-off-by: shen-shanshan <467638484@qq.com >
2026-04-22 22:46:14 -07:00
Flora Feng and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
8317cedc77
[Responses] Add tool_choice/tools validation to match OpenAI behavior ( #40399 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-22 22:46:10 -07:00
Zhengxu Chen
98a242ff61
[compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. ( #40151 )
...
Signed-off-by: zhxchen17 <zhxchen17@fb.com >
2026-04-23 13:43:18 +08:00
e4ee48da2d
[MoE refactor] refactor GPTQMarlinMoEMethod with MK ( #37990 )
...
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com >
2026-04-23 05:21:47 +00:00
Kunshang Ji
342c58bc54
[BugFix]fix Qwen3 MoE call gate twice ( #40664 )
...
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
2026-04-23 05:04:41 +00:00
fe9c3d6c5f
[TurboQuant] enable FA3/FA4 for prefill paths ( #40092 )
...
Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com >
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Codex <codex@openai.com >
2026-04-23 07:35:24 +03:00
Chaojun Zhang and Kunshang Ji
ccaf5ffaa3
[XPU] disable fusion pattern support on XPU platform ( #39789 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-04-23 10:07:45 +08:00
Lucas Kabela
0283f303d8
[BE] Fix compile time message to be consistent (use monitoring) ( #40641 )
...
Signed-off-by: Lucas Kabela <lucaskabela@meta.com >
2026-04-23 00:12:08 +00:00
Simon Danielsson and Matvei Pashkovskii
ac58e2a170
[Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router ( #39565 )
...
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com >
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com >
2026-04-23 08:06:31 +09:00
Lucas Kabela
b8401a9bf4
[Bugfix] Fix RMS norm + quant fusion on DeepGEMM UE8M0 path for B200 ( #40552 )
...
Signed-off-by: Lucas Kabela <lucaskabela@meta.com >
2026-04-22 22:04:42 +00:00
Honglin Cao
9c271f9403
[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes ( #38016 )
...
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com >
2026-04-22 21:31:00 +00:00
Lucas Kabela and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
22fa63cfe8
[Bugfix][Torch 2.12] Fix batch_invariant test with allow_override for torch 2.12 upgrade ( #40562 )
...
Signed-off-by: Lucas Kabela <lucaskabela@meta.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-22 13:48:55 -07:00
Wentao Ye and gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
8f87eb4622
[Refactor] Clean up log once scope="local" ( #40540 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-04-22 16:42:43 -04:00
cfa49213d7
[Bugfix][Parser] Fix Mistral pre-v11 tool parser failing on trailing model output ( #40531 )
...
Signed-off-by: dougbtv <dosmith@redhat.com >
Signed-off-by: Doug Smith <dougbtv@gmail.com >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-04-22 16:35:00 -04:00
Fynn Schmitt-Ulms and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
29f64c5f5e
FlexAttention non-causal support ( #40394 )
...
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-22 13:22:57 -07:00
Angela Yi
eb6661d522
Fix test_startup.py for torch 2.12 ( #40636 )
...
Signed-off-by: Angela Yi <yiangela7@gmail.com >
2026-04-22 19:31:41 +00:00
fxmarty-amd and Kyle Sayers
d622e27d2b
[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize TritonExperts usage for OCP MX emulation ( #35737 )
...
Signed-off-by: Felix Marty <Felix.Marty@amd.com >
Signed-off-by: fxmarty-amd <felmarty@amd.com >
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com >
2026-04-22 08:58:54 -07:00
Robert Shaw and Claude
5f76b3fb30
[MoE] Convert CT W8A8 To Oracle Structure ( #39187 )
...
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-22 14:53:30 +00:00
bnellnm
809d83c2dc
[MoE Refactor] Combine MoERunnerBase + DefaultMoERunner ( #40560 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-04-22 14:43:17 +00:00
Nicolò Lucchesi
33ef1941e2
[Bugfix][CI] Fix v1/kv_connector/unit/test_nixl_connector_hma.py::test_fewer_blocks_with_hma ( #40597 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-04-22 14:21:02 +01:00
Hank_
a4905133f3
[xpu][rocm] Update current_platform.supports_fp8() for TritonExperts ( #40132 )
...
Signed-off-by: Hank <hcc.mayday@gmail.com >
2026-04-22 13:39:40 +02:00
xiao and Wangxiaoxiaoa
ecbe42e991
[Doc] Clarify supported keys for --speculative-config ( #40455 )
...
Signed-off-by: Wangxiaoxiaoa <Wangxiaoxiaoa@users.noreply.github.com >
Co-authored-by: Wangxiaoxiaoa <Wangxiaoxiaoa@users.noreply.github.com >
2026-04-22 04:36:17 -07:00
a250f1bd5f
[Bugfix] LoRA for DeepSeek V3.2 ( #35077 )
...
Signed-off-by: Hollow Man <hollowman@opensuse.org >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-04-22 19:33:50 +08:00
lyd1992
04eac6ba24
[Bugfix][CPU][RISC-V] Clamp exp() input to prevent NaN ( #40428 )
...
Signed-off-by: liuyudong <liuyudong@iscas.ac.cn >
2026-04-22 09:38:18 +00:00
AllenDou and zixiao
9047288b68
support hotwords for FunASR model ( #39674 )
...
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com >
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com >
2026-04-22 02:25:06 -07:00