|
9e1cd262cb
|
[Bugfix] Use DP index for dense DP weight updates and EC CPU region (#56950)
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 22:44:36 +08:00 |
|
|
Robert ShawandClaude Opus 5
|
861a299adc
|
[Bugfix][Model Runner V2] Route dummy tokens to MoE experts during profiling (#57270)
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 10:11:14 -04:00 |
|
|
|
78fdf4efb8
|
[Bugfix][MoE] Convert FlashInfer BF16 weights in place (#54699)
Signed-off-by: Yuchen Wang <93700456+yuchenwang3@users.noreply.github.com>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-17 22:00:04 +08:00 |
|
|
|
117cf43fb6
|
[HARDWARE][POWER] Enable W8A8 INT8 MoE on POWER (#55316)
Signed-off-by: Rukhaiya <bibirukhaiya123@gmail.com>
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Antigravity <antigravity@google.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-17 21:45:13 +08:00 |
|
|
Shantipriya Parida
|
0eae9acd4d
|
[Bugfix][ROCm][MoE] Fall back instead of crashing when AITER MoE is requested for a non-gated (is_act_and_mul=False) model (#56590)
Signed-off-by: Shantipriya Parida <shantipriya.parida@amd.com>
|
2026-09-17 13:39:26 +00:00 |
|
|
Lucas WilkinsonandRobert Shaw
|
fe284ea17d
|
[BugFxi] Fix DeepGEMM FP8 workspace over allocation (#53914)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-09-17 09:35:34 -04:00 |
|
|
CaiJohnandjohn
|
75c71390d5
|
[Bugfix] Escape control characters in xgrammar choice grammar (#48115)
Signed-off-by: john <6712432+CaiJohn@users.noreply.github.com>
Co-authored-by: john <6712432+CaiJohn@users.noreply.github.com>
|
2026-09-17 15:57:47 +03:00 |
|
|
Harry MellorandClaude Opus 5
|
0ef8366ba3
|
[Frontend] Only show the summary line of config docstrings in --help (#57357)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 12:53:11 +00:00 |
|
|
MattandClaude Opus 5
|
8be3ca35f3
|
[ROCm][CI] Fix AMD CI pipeline upload rejected by an invalid block-step key (#57375)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 20:52:02 +08:00 |
|
|
Kevin H. Luu
|
f46968cb6e
|
[CI] Make ci-clean-log.sh portable to macOS/BSD sed (#57367)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-09-17 12:42:59 +00:00 |
|
|
Martín el CheikhandClaude
|
2e50824766
|
[Bugfix] Fall back to native sampling when FlashInfer cannot target the GPU (#48956)
Signed-off-by: martin el cheikh <martinelcheikh@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-17 12:27:54 +00:00 |
|
|
|
a85dd55177
|
Fix Laguna patch mutating flat RoPE parameters (#57189)
Signed-off-by: Laura López Real <laulopezreal@users.noreply.github.com>
Co-authored-by: Laura López Real <laulopezreal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 12:22:57 +00:00 |
|
|
Wentao Ye
|
91a4c40b45
|
[Compile] Fix compile warning #177-D (#56609)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-17 05:04:56 -07:00 |
|
|
Simon Danielsson
|
667b26e50b
|
[Bugfix][ROCm][GLM-5.3-Flash] Apply deferred tilelang.jit already on attribute access (#57192)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-17 12:02:39 +00:00 |
|
|
Yan MaandKunshang Ji
|
da3c07bf7d
|
[XPU][CI] skip test_hybrid_prefix_cache_hit_rate (#57301)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-17 19:57:22 +08:00 |
|
|
aoshen02andaoshen02
|
9ff08f9493
|
[Bugfix] Honor skip_reading_prefix_cache for KV connector hits (#57269)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-09-17 03:46:28 -07:00 |
|
|
|
0d72627565
|
[Perf][EPD] Batch image requests per encoder (#57095)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 03:45:52 -07:00 |
|
|
Kevin H. LuuandKimi
|
99ea5f525d
|
[CI] Raise DSv4-Flash disaggregated engine readiness timeout to 1800s (#57334)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-17 03:34:00 -07:00 |
|
|
Kevin H. LuuandKimi
|
683f6c8edf
|
[CI] Raise H200 LM Eval Large Models timeout to 120 min (#57335)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-17 03:33:44 -07:00 |
|
|
Itay EtelisandOr Ozeri
|
b6e7c1f1f0
|
[kv_offload] Skip scratch groups (#57145)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-17 13:22:49 +03:00 |
|
|
|
40b40d1d39
|
[Bugfix][KV Offload] Register the offload region in chunks (#51081)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Colton Ottley <coltonottley@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-17 13:19:56 +03:00 |
|
|
|
08633cb5cd
|
[Qwen3.8-Flash-Next] Enable FP8 TP with FlashInfer TRTLLM MoE (#55867)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-17 08:56:28 +00:00 |
|
|
|
f1c2f6ada8
|
[ROCm][CI] Stage H gating and MI355 test reallocation (#57080)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-17 01:44:11 -07:00 |
|
|
|
23cd0346ce
|
[CPU] Align scheduler and NIXL CPU affinity per local rank (#53636)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-17 16:43:08 +08:00 |
|
|
coderfornowandLi, Jiang <jiang1.li@intel.com>
|
88afb77700
|
[CPU][s390x] Pin protobuf to 7.36.1 and drop C++ extension removal workaround (#54978)
Signed-off-by: coderfornow <Ritik.Dhiranan@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-17 16:35:17 +08:00 |
|
|
jiangkuaixue123andCodex
|
de24e51908
|
[MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 16:12:17 +08:00 |
|
|
Jiahan Chang (Cyrus)andOpenAI Codex
|
4e5ffda19d
|
[Bugfix] Isolate supplemental FlashInfer BF16 autotuning (#57285)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 07:38:58 +00:00 |
|
|
|
528fa835fd
|
[ROCm] Stage large pageable H2D copies instead of registering them (#56343)
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-17 07:14:43 +00:00 |
|
|
leoandOpenAI Codex
|
b3079e6e46
|
[Perf][DSpark] Stack DeepSeek V4 context WKV projections (#54674)
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 00:04:53 -07:00 |
|
|
Shuolei WangandRoger Wang
|
7bbce752b8
|
[Perf][Model] Qwen4Exp QSA: sm_90 tuning table for _select_config (#57273)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-09-17 07:02:24 +00:00 |
|
|
Lucas Wilkinson
|
bd2d7ae7c1
|
[Perf] Reuse MoE workspace for DeepGEMM warmup (#57268)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-17 03:01:19 -04:00 |
|
|
Shanshan Shen
|
fdcd42350b
|
[ROCm][Perf] Enable HCA dual-stream overlap for DeepSeek-V4 (#56853)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-17 06:46:00 +00:00 |
|
|
aoshen02
|
b978df3299
|
Revert "[Frontend] Omit absent fields from /inference/v1/generate stream chunks" (#57302)
|
2026-09-16 23:31:59 -07:00 |
|
|
aoshen02andClaude Fable 5.1
|
8538017f4b
|
[Frontend] Omit absent fields from /inference/v1/generate stream chunks (#57264)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-17 05:58:56 +00:00 |
|
|
Qiming Zhang
|
e6b1a5e5e3
|
[XPU] Enable XPU eplb (#44987)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
|
2026-09-17 13:19:13 +08:00 |
|
|
|
2743dc4f92
|
[Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 13:16:41 +08:00 |
|
|
Matt
|
2d8a5c5741
|
[ROCm][Bugfix] Reduce CUDA graph divergences (#57229)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-09-17 05:12:13 +00:00 |
|
|
Kevin H. Luu
|
0bfc7a15d0
|
[CI] Fix ruff docstring violations in EC connector files (#57283)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-09-16 21:13:15 -07:00 |
|
|
Robert ShawandRobert Shaw
|
c38f92aae7
|
[A2A] Allow EPLB + SharedExpert Overlap + DeepEPv2 (#57236)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
|
2026-09-17 04:02:39 +00:00 |
|
|
MattandClaude Code
|
68f2c7e74f
|
[ROCm][CI] Fix Nixl+Offloading PD edge cases on TheRock image (#57249)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-09-16 22:56:13 -05:00 |
|
|
Alec
|
d2a2a82954
|
[Rust Frontend] Bump vllm-proto to 0.3.0 (#57233)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
|
2026-09-17 03:41:55 +00:00 |
|
|
Itay EtelisandOr Ozeri
|
9854b580df
|
[Bugfix][KV Offload] Compact canonical MLA rows (#56799)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-17 06:24:06 +03:00 |
|
|
Nick Hill
|
5efbf0886a
|
[CI] Support FORCE_COLOR env var; enable colors in CPU CI output (#56913)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-09-16 22:40:21 -04:00 |
|
|
omerpaz95
|
fa3622a4a1
|
[EC Connector] Add Metrics Collection (#54960)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
|
2026-09-17 10:36:23 +08:00 |
|
|
Oxana KorzhandAndreas Karatzas
|
2307a1d16c
|
[Core] Don't issue a blocking collective RPC during engine handshake (#57226)
Signed-off-by: okorzh <okorzh@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-16 21:30:59 -05:00 |
|
|
Chuan (Richard) LiandCursor
|
f730a93d2b
|
[Scheduler] Add --max-num-active-seqs to cap RUNNING admission (#56758)
Signed-off-by: Li <chuali@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-17 10:22:12 +08:00 |
|
|
Jiangyun ZhuandCodex
|
b1f9ebc0c3
|
[Test][Core] Add hybrid model prefix cache hit-rate coverage (#57127)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 19:17:45 -07:00 |
|
|
|
062f81d8ef
|
Use skip-redaction option for crcr-report (#56532)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 19:01:54 -07:00 |
|
|
AlecandCodex
|
28ec03bc6e
|
[Bugfix][Rust Frontend] Accept appended EngineCoreOutput fields (#56533)
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
|
2026-09-17 01:54:43 +00:00 |
|
|
dongluwandAndreas Karatzas
|
19b6ff62f2
|
[ROCm][Bugfix] Ignore descales for unquantized AITER caches (#56726)
Signed-off-by: donglu <donglu@cohere.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 01:29:50 +00:00 |
|