 Flora FengandChauncey
|
80dd705c1d
|
[Frontend] Make finish_reason and Responses item status truthful (#59324)
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-10-15 10:12:02 +01:00 |
|
|
Denis KhachyanandClaude Code
|
427915bed2
|
[Build][CPU] Install Run:ai Model Streamer in vllm-openai-cpu image (#61382)
Signed-off-by: Denis Khachyan <khachyanda@gmail.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-15 09:11:51 +00:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
7f730b4cea
|
[CI] Run 4xH100 steps nightly only (#61782)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 01:32:43 -07:00 |
|
|
wang.yuqi
|
0f0bc4dbb1
|
[Test] Split the chat_utils tests. (#61765)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-10-15 08:26:22 +00:00 |
|
|
|
b965ee564d
|
[Chore] Use upstream Transformers DeepseekV4Config (#61392)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 01:08:08 -07:00 |
|
|
Misha GoinandClaude Opus 5.5
|
1c4c319792
|
[Frontend] Advertise --enable-x/--disable-x for boolean CLI flags (#61479)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 01:08:02 -07:00 |
|
|
|
48f17b77bb
|
[Bugfix] Reject mismatched float16/bfloat16 KV cache dtype (#60885)
Signed-off-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 08:06:59 +00:00 |
|
|
|
fc8e08a2a6
|
[Bugfix][KV Offload] Do not let mark_miss() flip a pending or in-flight async lookup probe (#59096)
Signed-off-by: Sohom Chakraborty <16609933+sohom-cs@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 10:57:46 +03:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
8fa5ae844a
|
[Frontend] Let an unset --tool-strict-level fall back to the tool parser's default (#61328)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 15:48:38 +08:00 |
|
|
|
91ed2859c7
|
[CPU][Zen] Update zentorch to 2.14.0.1 & enable float16 on Venice and later (#61411)
Signed-off-by: Ganesh R <ganesh.r@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-15 00:23:50 -07:00 |
|
|
|
85c94c1706
|
[Tests][XPU] Skip modelopt_fp4 online MoE re-quantization test on XPU (#61723)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-15 00:23:45 -07:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
8f111b22ee
|
[CI] Run 4xB200 steps nightly only (#61541)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 00:08:48 -07:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
32feecd91f
|
[CI] Pin DeepSeek-V4.1-Flash-NVFP4 eval to its FP8-Engram revision (#61763)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 00:05:18 -07:00 |
|
|
Chaojun ZhangandKevin H. Luu
|
ab593678b5
|
[CI][XPU] Ignore test_reload.py on Intel CI (#61740)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 15:03:34 +08:00 |
|
|
|
a9fe30e9f6
|
[Bugfix][Multimodal] Recover PyNvVideoCodec decoder slots after failures (#59597)
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Signed-off-by: danielafrimi <45691845+danielafrimi@users.noreply.github.com>
Signed-off-by: Daniel Afrimi <dafrimi@oci-hsg-cs-001-login-02.cm.cluster>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Daniel Afrimi <dafrimi@oci-hsg-cs-001-login-02.cm.cluster>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
|
2026-10-15 09:17:19 +03:00 |
|
|
liranschourandKevin H. Luu
|
c5f8adc0b1
|
[KV Offload] Expose OffloadingManager.lock()/unlock() and service the tiering control plane off the scheduler thread (#58168)
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 08:50:56 +03:00 |
|
|
HarshilandCyrus Leung
|
c54dca96bd
|
[Bugfix][Benchmark] Fix probe latency and duration in bench serve (#60511)
Signed-off-by: QHarshil <harshil_c@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-15 05:50:30 +00:00 |
|
|
|
5341b5ba7d
|
[KV Offload] Pin only each worker's own offload slots (#59544)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-15 08:49:42 +03:00 |
|
|
|
6605802904
|
[Perf][KV Connector][Mooncake] Send the KV layout once per peer (#59825)
Signed-off-by: staryxchen <staryxchen@tencent.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-10-15 05:36:31 +00:00 |
|
|
|
a400804ce4
|
[CI] Relax MTP sharded sampling cross-boot noise bound (#57026)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 22:31:45 -07:00 |
|
|
|
3f1bcfd82b
|
[Bugfix][KV Offload] Bound unanswered P2P lookup waits (#56836)
Signed-off-by: jacklin78911-collab <jacklin78911@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 08:23:34 +03:00 |
|
|
|
81e1c3f183
|
[XPU][MLA] Integrate XPU MLA support into the existing FLASH_ATTN_MLA backend (#58297)
Signed-off-by: baodii <di.bao@intel.com>
Signed-off-by: Zhouxiaoya25 <xiaoya.zhou@intel.com>
Signed-off-by: ZhouXiaoya25 <xiaoya.zhou@intel.com>
Co-authored-by: baodii <di.bao@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-15 12:47:37 +08:00 |
|
|
Vivaan SharmaandKevin H. Luu
|
96b5b0ee4b
|
[Model] Enable torch.compile and CUDA graphs for EmbeddingGemma2 (#61572)
Signed-off-by: Vivaan Sharma <99265792+Vivaansharma2003@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 12:32:39 +08:00 |
|
|
Haiyu ZuoandKevin H. Luu
|
ff5a91a456
|
[Feature][Model Loader] Apply model-owned MTP shard selection to RunAI ModelStreamer (#60759)
Signed-off-by: 浩韵 <zuohaiyu.zhy@alibaba-inc.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 12:23:11 +08:00 |
|
|
Chaitanya Sri Krishna LollaandCursor
|
833665cded
|
[ROCm][DI] Enable MoRI FP4 dispatch for mxfp4 w4a4 moe (#59596)
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-14 23:20:14 -05:00 |
|
|
Tuukka SarviandKevin H. Luu
|
10d2c6083d
|
[ROCm][DSv4.1] Enable DSpark adaptive verification (#58151)
Signed-off-by: Tuukka Sarvi <tuukka.sarvi@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-15 12:05:43 +08:00 |
|
|
Shanshan Shen
|
f46021a7fa
|
[ROCm][Perf] Enable DPA+ETP prefill compute/comm dual-batch-overlap for DeepSeek-V4 (#57773)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Signed-off-by: shen-shanshan <467638484@qq.com>
|
2026-10-15 11:16:48 +08:00 |
|
|
FeanorandTaneem Ibrahim
|
5d5c3d7c43
|
[Bugfix] Preserve padding token types for cross encoders (#58143)
Signed-off-by: zhaoye <772971548@qq.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-10-15 03:09:24 +00:00 |
|
|
|
429a3da665
|
[Bugfix][ROCm][Disagg] Allow MoRIIO HMA per-layer block_len (#58585)
Signed-off-by: avininjamay8 <Avinash.Paul@amd.com>
Signed-off-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-10-15 09:35:31 +08:00 |
|
|
KaiandKunshang Ji
|
de2b869ee9
|
[Bugfix][Kernel] Register int8 scaled_mm as a custom op (#57331)
Signed-off-by: Kai <limkc.reply@gmail.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-15 09:27:49 +08:00 |
|
|
Aarushi Jain
|
2abd479aee
|
[ROCm][CI] Add AMD job for DeepSeek-V4.1 Mono Decode Numerics (#61720)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
|
2026-10-15 01:23:25 +00:00 |
|
|
Woosuk KwonandClaude Opus 5.5
|
e57bb4ace7
|
[Core] Remove the legacy Ray compiled-graph executor (#61712)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 18:13:27 -07:00 |
|
|
|
bfdbfa1632
|
[Bugfix][PCP] Align MoE routing padding with gathered tokens (#60946)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: wangyicong <wangyicong@bytedance.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-14 21:04:00 -04:00 |
|
|
Woosuk KwonandClaude Opus 5.5
|
8530aed2b7
|
[Spec Decode] Remove Medusa and MLP speculator support (#61701)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 17:29:23 -07:00 |
|
|
josh-schell-amdandClaude Opus 5.5
|
273a04964e
|
[ROCm] Bump AITER to v0.1.25 and relax the DSv4.1 mono MoE tolerance (#61697)
Signed-off-by: josh schell <josh.schell@amd.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-14 23:50:24 +00:00 |
|
|
Aarushi JainandAndreas Karatzas
|
7840bede98
|
[ROCm][CI] Add AMD jobs for test groups that only exist in tes… (#59678)
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-14 23:00:44 +00:00 |
|
|
Kevin H. Luu
|
4b61f300c0
|
[CI] Fix /ci run reporting a failed merge on fork PRs (#61684)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-10-14 15:26:15 -07:00 |
|
|
Micah Williamson
|
a4d553a46a
|
Revert "[Build] Update deep_gemm git tag for locality_domain update" (#61703)
|
2026-10-14 14:57:44 -07:00 |
|
|
Rohan PotdarandClaude Opus 5.5
|
9a648b4649
|
[ROCm][Kimi-K3] Don't read W_UK_T before weight loading in the MLA wrapper (#61654)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 21:44:55 +00:00 |
|
|
Ben BrowningandFlora Feng
|
4c5ea86f53
|
[Bugfix][Parser] Stream Gemma4 string tool arguments incrementally (#61494)
Signed-off-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-14 21:25:41 +00:00 |
|
|
|
984c242ede
|
[Quantization] Support compressed-tensors MXFP4 MoE with FP8 activations via Mxfp4MoEMethod (#59815)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-14 13:33:35 -07:00 |
|
|
|
fe98d90a9d
|
[Dependency] Update Humming and remove NVFP4 scale workaround (#61556)
Signed-off-by: jinzhen.ljz <jinzhen.ljz@antgroup.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-14 13:32:36 -07:00 |
|
|
Woosuk KwonandClaude Opus 5.5
|
2e8a5930f6
|
[Benchmark] Remove the temporary bench forward dummy loader (#61676)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:30:18 -07:00 |
|
|
Juntian Liu
|
7c3f7e5500
|
[Perf][DSv4.1] Length-aware candidate block selection in the decode indexer (#61039)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
|
2026-10-14 20:15:58 +00:00 |
|
|
rasmithandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2622ee21aa
|
[ROCm][BugFix] Don't use AITER rms_norm as an IR OP on gfx90a when AITER always on. (#59290)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-14 12:48:37 -07:00 |
|
|
alpandmottopanikeiku
|
e73fa00981
|
[Bugfix][Frontend] Apply the JSON schema in Cohere Chat v2 response_format (#60586)
Signed-off-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
Co-authored-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com>
|
2026-10-14 19:42:20 +00:00 |
|
|
Chris LeonardandShengqi Chen
|
ded7ae35e5
|
[Build] Update deep_gemm git tag for locality_domain update (#61491)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-10-14 15:41:16 -04:00 |
|
|
Juntian LiuandClaude Opus 5.5
|
388a610dfb
|
[Perf][DFlash] Capture context combine and anchor in the draft CUDA graph (#59511)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-14 15:40:52 -04:00 |
|
|
Wei ZhaoandJee Jee Li
|
4975fda882
|
[Dependency] Upgrade FlashInfer to 0.7.1 (#60948)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-10-14 12:31:08 -07:00 |
|
|
Ayushman Singh
|
9b5c6707a3
|
[Bugfix][MRV2] Capture DCP FULL cudagraphs with KV context (#61496)
Signed-off-by: Ayushman Singh <40520701+ayush1399@users.noreply.github.com>
|
2026-10-14 19:20:48 +00:00 |
|