 Sriram KumarandDouglas Lehr
|
ff6b5808c4
|
[ROCm] Resolve the indexer fp8 cache dtype once at import (#53792)
Signed-off-by: Sriram Kumar <sriramkumar.kishorekumar@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
|
2026-09-17 17:51:35 +00:00 |
|
 Wentao YeandFlora Feng
|
f3aa88d230
|
[Kimi K3 Bug] Fix kimi k3 reasoning parser (#57098)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-17 10:05:52 -07:00 |
|
 
|
b2f2bd71ba
|
[CI][Bugfix] Add tp_shard_with_padding to padded MoE reload test mock (#57402)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-17 13:02:24 -04:00 |
|
 MattandClaude Opus 5
|
e30bf70c5d
|
[ROCm][CI] Fix Entrypoints Integration (Pooling) tests on TheRock image (#57380)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 11:22:39 -05:00 |
|
 MattandClaude Opus 5
|
fef55fd26d
|
[ROCm][CI] Adapt MoE tests to the triton_kernels 3.8 API (#57385)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 11:21:22 -05:00 |
|
 Taneem IbrahimandHarry Mellor
|
e960ead0aa
|
[Mypy] Fix mypy typing for Transformers models (#54320)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-17 12:11:31 -04:00 |
|
 YoungandYoung
|
b78fbab4be
|
[Docs] Fix the typos in the document (#57190)
Co-authored-by: Young <yangchh15@163.com>
|
2026-09-17 15:52:10 +00:00 |
|
 
|
d7e755c230
|
[Bugfix] Fix wrong vLLM version reported by pip install (proto-v* tag collision) (#57295)
Signed-off-by: RyanMa29 <ziyang.ma@intel.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 08:50:14 -07:00 |
|
Zoe923
|
6a7de3ba3a
|
[Bugfix][GDN] Fix CuteDSL BF16 KKT inversion divergence (#53864)
Signed-off-by: Zoe923 <871844693@qq.com>
|
2026-09-17 08:49:56 -07:00 |
|
 HieDeanandhiedean
|
493d4b3c04
|
[bugfix] Mark draft tokens to rebuilt their embeddings. (#57356)
Signed-off-by: HieDean <799287043@qq.com>
Co-authored-by: hiedean <hiedean@tju.edu.cn>
|
2026-09-17 15:20:37 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) 
|
1df336c3ba
|
[Perf][ROCm] Enable AITER QuickReduce + RMSNorm fusion (#48249)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 15:05:48 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png)   
|
4f9a41ac94
|
[CI/Build][Hardware][NVIDIA] Add Rubin CUDA 13.4 nightly images (#55953)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 08:05:31 -07:00 |
|
 vllmellmandTJian
|
3affd35f31
|
[Fix][ROCm] MXFP4 MoE round-up inflates TP-sharded expert weights on CDNA3, starving KV cache (#56359)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-09-17 22:52:12 +08:00 |
|
akii96
|
438434b5b5
|
[ROCm][Perf] Insert MiniMax-M3 sparse-PA K/V without a contiguous copy (#56849)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-09-17 09:44:54 -05:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png)   
|
9e1cd262cb
|
[Bugfix] Use DP index for dense DP weight updates and EC CPU region (#56950)
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 22:44:36 +08:00 |
|
 Robert ShawandClaude Opus 5
|
861a299adc
|
[Bugfix][Model Runner V2] Route dummy tokens to MoE experts during profiling (#57270)
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 10:11:14 -04:00 |
|
  
|
78fdf4efb8
|
[Bugfix][MoE] Convert FlashInfer BF16 weights in place (#54699)
Signed-off-by: Yuchen Wang <93700456+yuchenwang3@users.noreply.github.com>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-17 22:00:04 +08:00 |
|
  
|
117cf43fb6
|
[HARDWARE][POWER] Enable W8A8 INT8 MoE on POWER (#55316)
Signed-off-by: Rukhaiya <bibirukhaiya123@gmail.com>
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Antigravity <antigravity@google.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-17 21:45:13 +08:00 |
|
Shantipriya Parida
|
0eae9acd4d
|
[Bugfix][ROCm][MoE] Fall back instead of crashing when AITER MoE is requested for a non-gated (is_act_and_mul=False) model (#56590)
Signed-off-by: Shantipriya Parida <shantipriya.parida@amd.com>
|
2026-09-17 13:39:26 +00:00 |
|
 Lucas WilkinsonandRobert Shaw
|
fe284ea17d
|
[BugFxi] Fix DeepGEMM FP8 workspace over allocation (#53914)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-09-17 09:35:34 -04:00 |
|
 CaiJohnandjohn
|
75c71390d5
|
[Bugfix] Escape control characters in xgrammar choice grammar (#48115)
Signed-off-by: john <6712432+CaiJohn@users.noreply.github.com>
Co-authored-by: john <6712432+CaiJohn@users.noreply.github.com>
|
2026-09-17 15:57:47 +03:00 |
|
 Harry MellorandClaude Opus 5
|
0ef8366ba3
|
[Frontend] Only show the summary line of config docstrings in --help (#57357)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 12:53:11 +00:00 |
|
 MattandClaude Opus 5
|
8be3ca35f3
|
[ROCm][CI] Fix AMD CI pipeline upload rejected by an invalid block-step key (#57375)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 20:52:02 +08:00 |
|
Kevin H. Luu
|
f46968cb6e
|
[CI] Make ci-clean-log.sh portable to macOS/BSD sed (#57367)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-09-17 12:42:59 +00:00 |
|
 Martín el CheikhandClaude
|
2e50824766
|
[Bugfix] Fall back to native sampling when FlashInfer cannot target the GPU (#48956)
Signed-off-by: martin el cheikh <martinelcheikh@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-17 12:27:54 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) 
|
a85dd55177
|
Fix Laguna patch mutating flat RoPE parameters (#57189)
Signed-off-by: Laura López Real <laulopezreal@users.noreply.github.com>
Co-authored-by: Laura López Real <laulopezreal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 12:22:57 +00:00 |
|
Wentao Ye
|
91a4c40b45
|
[Compile] Fix compile warning #177-D (#56609)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-17 05:04:56 -07:00 |
|
Simon Danielsson
|
667b26e50b
|
[Bugfix][ROCm][GLM-5.3-Flash] Apply deferred tilelang.jit already on attribute access (#57192)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-17 12:02:39 +00:00 |
|
 Yan MaandKunshang Ji
|
da3c07bf7d
|
[XPU][CI] skip test_hybrid_prefix_cache_hit_rate (#57301)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-17 19:57:22 +08:00 |
|
 aoshen02andaoshen02
|
9ff08f9493
|
[Bugfix] Honor skip_reading_prefix_cache for KV connector hits (#57269)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-09-17 03:46:28 -07:00 |
|
 
|
0d72627565
|
[Perf][EPD] Batch image requests per encoder (#57095)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 03:45:52 -07:00 |
|
 Kevin H. LuuandKimi
|
99ea5f525d
|
[CI] Raise DSv4-Flash disaggregated engine readiness timeout to 1800s (#57334)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-17 03:34:00 -07:00 |
|
 Kevin H. LuuandKimi
|
683f6c8edf
|
[CI] Raise H200 LM Eval Large Models timeout to 120 min (#57335)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-17 03:33:44 -07:00 |
|
 Itay EtelisandOr Ozeri
|
b6e7c1f1f0
|
[kv_offload] Skip scratch groups (#57145)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-17 13:22:49 +03:00 |
|
  
|
40b40d1d39
|
[Bugfix][KV Offload] Register the offload region in chunks (#51081)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Colton Ottley <coltonottley@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-17 13:19:56 +03:00 |
|
 
|
08633cb5cd
|
[Qwen3.8-Flash-Next] Enable FP8 TP with FlashInfer TRTLLM MoE (#55867)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-17 08:56:28 +00:00 |
|
 
|
f1c2f6ada8
|
[ROCm][CI] Stage H gating and MI355 test reallocation (#57080)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-17 01:44:11 -07:00 |
|
 
|
23cd0346ce
|
[CPU] Align scheduler and NIXL CPU affinity per local rank (#53636)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-17 16:43:08 +08:00 |
|
 coderfornowandLi, Jiang <jiang1.li@intel.com>
|
88afb77700
|
[CPU][s390x] Pin protobuf to 7.36.1 and drop C++ extension removal workaround (#54978)
Signed-off-by: coderfornow <Ritik.Dhiranan@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-17 16:35:17 +08:00 |
|
 jiangkuaixue123andCodex
|
de24e51908
|
[MM][V2] Enable encoder-only ViT CUDA graph capture (#56922)
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 16:12:17 +08:00 |
|
 Jiahan Chang (Cyrus)andOpenAI Codex
|
4e5ffda19d
|
[Bugfix] Isolate supplemental FlashInfer BF16 autotuning (#57285)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 07:38:58 +00:00 |
|
 
|
528fa835fd
|
[ROCm] Stage large pageable H2D copies instead of registering them (#56343)
Signed-off-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-17 07:14:43 +00:00 |
|
 leoandOpenAI Codex
|
b3079e6e46
|
[Perf][DSpark] Stack DeepSeek V4 context WKV projections (#54674)
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-17 00:04:53 -07:00 |
|
 Shuolei WangandRoger Wang
|
7bbce752b8
|
[Perf][Model] Qwen4Exp QSA: sm_90 tuning table for _select_config (#57273)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-09-17 07:02:24 +00:00 |
|
Lucas Wilkinson
|
bd2d7ae7c1
|
[Perf] Reuse MoE workspace for DeepGEMM warmup (#57268)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-09-17 03:01:19 -04:00 |
|
Shanshan Shen
|
fdcd42350b
|
[ROCm][Perf] Enable HCA dual-stream overlap for DeepSeek-V4 (#56853)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-09-17 06:46:00 +00:00 |
|
aoshen02
|
b978df3299
|
Revert "[Frontend] Omit absent fields from /inference/v1/generate stream chunks" (#57302)
|
2026-09-16 23:31:59 -07:00 |
|
 aoshen02andClaude Fable 5.1
|
8538017f4b
|
[Frontend] Omit absent fields from /inference/v1/generate stream chunks (#57264)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-17 05:58:56 +00:00 |
|
Qiming Zhang
|
e6b1a5e5e3
|
[XPU] Enable XPU eplb (#44987)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
|
2026-09-17 13:19:13 +08:00 |
|
  
|
2743dc4f92
|
[Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 13:16:41 +08:00 |
|