 Cyrus Leung
|
dbf4b89cf2
|
[Misc] Remove unnecessary Transformers version guards (#57556)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-18 15:01:35 +00:00 |
|
|
|
1cdf1689e5
|
[Quantization][XPU] Enable int8_w8a8 MoE on the Triton backend for XPU (#53162)
Signed-off-by: Artur Fierka <artur.fierka@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-18 22:38:15 +08:00 |
|
|
Martin Hickey
|
70164bdadc
|
[Frontend] Add stream reasoning and tool calls from the derender endpoint (#50550)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-09-18 16:36:27 +02:00 |
|
|
Kevin Liandkevinli
|
911548247a
|
[Distributed][MoonEP] BF16 integration of MoonEP balanced EP backend (#52101)
Signed-off-by: kevinli <306243285+kaijunli-infr@users.noreply.github.com>
Co-authored-by: kevinli <306243285+kaijunli-infr@users.noreply.github.com>
|
2026-09-18 10:34:01 -04:00 |
|
|
Julien DebacheandHarry Mellor
|
2bdae2a5a8
|
[fix] Mistral-Large-3 accuracy regression on main (#57563)
Signed-off-by: jdebache <jdebache@nvidia.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-18 14:19:16 +00:00 |
|
|
Kyle SayersandMisha Goin
|
76d517fd12
|
[Quantization] Support kimi-k3 routed expert quant (#57430)
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-18 08:03:59 -06:00 |
|
|
|
44dd18fe0b
|
[Model][Gemma4] Load Weights with AutoWeightsLoader (#55911)
Signed-off-by: Josephasafg <ajgard7@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-18 12:07:30 +00:00 |
|
|
Taneem Ibrahim
|
2b8a5495a8
|
[Mypy] Fix mypy typing for N/O models (#54142)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-18 12:50:01 +01:00 |
|
|
|
e562003adb
|
[Tokenizer] Drop dead Mistral tokenizer shims for transformers#41962 (#56325)
Signed-off-by: Aditya Ganesh Kumar <adty910@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-18 12:46:41 +01:00 |
|
|
|
c58532c86b
|
[Frontend] Upgrade XGrammar to 0.2.7 and Rust structural tags to 0.3.0 (#57272)
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-18 11:44:05 +00:00 |
|
|
|
cc09352e5c
|
[Bugfix][Multimodal] Preserve DeepSeek V4 image block spacing (#56882)
Signed-off-by: Xucheng Zhou <aden1350@outlook.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-18 18:44:39 +08:00 |
|
|
Kevin H. Luu
|
04a3a00eb7
|
[CI] Raise GSM8K startup max wait to 2400s for flaky 30B+ MoE eval configs (#57361)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-09-18 03:40:54 -07:00 |
|
|
Kevin H. LuuandKimi
|
f2b6152ec2
|
[CI] Add flaky rerun markers / timeout skips to sibling tests lacking them (#57359)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-18 03:40:32 -07:00 |
|
|
Matt
|
4c6c1a40b3
|
[ROCm][Bugfix] Fix intermittent ROCR host segfault (#57328)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-09-18 03:13:45 -07:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
5397f967b9
|
[CI] Add residual timeout headroom after JIT rollback (#56649)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-18 03:11:07 -07:00 |
|
|
vllm-agentandkimi-no-na-wa
|
5bb596201a
|
[CI] Raise Elastic EP Scaling step timeout 30m -> 40m (#57287)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
|
2026-09-18 03:10:38 -07:00 |
|
|
Yuwen ZhouandLi, Jiang <jiang1.li@intel.com>
|
b346479065
|
[CPU] Add CPU FP8 W8A8 linear/MoE support (#49942)
Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-18 17:59:42 +08:00 |
|
|
meng-amd
|
6df2b1a8c6
|
[Quantization] Support native Quark W4A16 INT4/UINT4 exports in vLLM (#48606)
Signed-off-by: HongWei Meng <HongWei.Meng@amd.com>
|
2026-09-18 17:52:46 +08:00 |
|
|
shaohuaxiandCodex
|
67a8a3f926
|
[Bugfix][CPU] Fix macOS multimodal SHM cache initialization (#57142)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-18 09:05:13 +00:00 |
|
|
olka-amdandClaude Opus 5
|
32636580a6
|
[Bugfix][MLA] TritonMLA: fix illegal memory access on causal multi-token decode (#51065)
Signed-off-by: Oleksandr Kachur <oleksandr.kachur@amd.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-18 03:49:53 -05:00 |
|
|
Thien TranandCodex
|
8da75d6190
|
C3x SM100 FP8 blockwise - Pad activation scales to multiple of 4 (#57377)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-18 08:39:27 +00:00 |
|
|
Biswa PandaandBugen Zhao
|
95d723700b
|
[Rust Frontend] Return sampling masks over gRPC (#56777)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
|
2026-09-18 08:26:17 +00:00 |
|
|
Micah WilliamsonandAndreas Karatzas
|
d5f0a6e829
|
[Bugfix][DBO] Fix DeepEP low-latency profiling crash with DP+EP+DBO (#57502)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-18 06:33:41 +00:00 |
|
|
SunandCodex
|
42a33039eb
|
[Perf] Fuse CohereASR relative attention score accumulation (#55190)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-18 06:18:41 +00:00 |
|
|
|
39e33db7f3
|
[Frontend] Fix the parsing of missing string= in DeepSeek V4 (#56271)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
|
2026-09-18 05:11:24 +00:00 |
|
|
|
dee37d8911
|
[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-18 04:32:39 +00:00 |
|
|
|
d12c276853
|
[Bugfix][ROCm] Alias SparseAttnIndexerKpool.forward_cuda to forward_native (GLM-5.3-Flash boot crash) (#57425)
Signed-off-by: Mustafa YILDIRIM <mustafa@character.ai>
Co-authored-by: Hermes Agent <hermes@nousresearch.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-09-18 03:36:55 +00:00 |
|
|
Juntian LiuandWoosuk Kwon
|
bf13ecc2f7
|
[Perf][MRV2] Share token-to-request mappings across KV cache groups (#57102)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-09-18 03:14:36 +00:00 |
|
|
JasonandChauncey
|
2909ad8fa4
|
[Bugfix] Attach request-level tools to existing system message in DeepSeek V4 Python renderer (#51856)
Signed-off-by: Jason Yao <wsyjh8@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-18 11:07:25 +08:00 |
|
|
Simon Danielsson
|
70df48dc3d
|
[Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317)
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
|
2026-09-17 22:42:54 -04:00 |
|
|
Ren Yuzhou
|
7b94293627
|
[Bugfix][ROCm][KV Offload] Use private pinned tensors for CPU KV offload (#57160)
Signed-off-by: Yuzhou Ren <ryzcqu@outlook.com>
|
2026-09-18 02:35:23 +00:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2bbdfcfcfe
|
[Perf][GLM5.3-Flash] Use cooperative top-k for small GLM decode batches (#57327)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-18 10:31:35 +08:00 |
|
|
Woosuk KwonandCodex
|
64563d0ec4
|
[Bugfix][DSv4.1] Preserve NaN-scored candidate block indices (#57454)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 19:00:10 -07:00 |
|
|
Matt Mastracci
|
2c88fb131c
|
[Bugfix] DiffusionGemma: hand out stashed logprobs only on the committing step (#57414)
|
2026-09-17 20:24:58 -04:00 |
|
|
Rohan PotdarandClaude
|
213c379fca
|
[ROCm][Bugfix] Gate AITER MXFP8 MoE on the aiter enable flag (#57426)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-18 00:06:05 +00:00 |
|
|
Yan Ma
|
48f663c37f
|
[XPU] Fix incorrect context-key normalization for Qwen DFlash-based models (#56431)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-09-18 07:52:01 +08:00 |
|
|
|
092bdd6d57
|
[Frontend][Core] Add release_kv_cache_memory() API (#44890)
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Dakai An <77474977+andakai@users.noreply.github.com>
Co-authored-by: AlanFokCo <alanfok2868@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-18 07:12:12 +08:00 |
|
|
|
a524f80b1f
|
[AMD][Bugfix] Make the nested-RoPE patch reach automatic validation (#57289)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 18:09:06 -05:00 |
|
|
Wei Zhao
|
ccde9c61e9
|
[Bugfix] Restore KV cache metadata GET method for external event consumer (#56925)
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-09-17 23:01:35 +00:00 |
|
|
|
e0050f287a
|
[Bugfix][ROCm] Add record_logical_topk_ready to ROCMAiterMLASparseImpl (GLM-5.3-Flash boot crash) (#57252)
Signed-off-by: Mustafa YILDIRIM <mustafa@character.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 22:34:56 +00:00 |
|
|
Woosuk KwonandCodex
|
80447d2765
|
[Bugfix][DSv4.1] Fix FlashInfer DSpark non-causal attention (#57432)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 15:14:37 -07:00 |
|
|
rasmithandAndreas Karatzas
|
d3074acdda
|
[AMD][CI][The Rock] Fix language models standard for The Rock on mi355 (#53837)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-17 22:13:13 +00:00 |
|
|
|
e8a2a0a8bb
|
[Bugfix][Frontend] Reject stop strings on --tokens-only servers instead of silently ignoring them (#57058)
Signed-off-by: Shimi Bandiel <shimib@google.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-17 22:02:00 +00:00 |
|
|
Misha Goin
|
ac78445bc9
|
[MoE] Encapsulate TRT-LLM BF16 weight layout handling (#57405)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-17 17:47:30 -04:00 |
|
|
Misha Goin
|
db7a24c230
|
[Perf] Add fused DFlash2 grouped convolution (#55960)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-17 21:38:59 +00:00 |
|
|
|
668d6c3a77
|
[CI] Shard multimodal Processor 1->4 (#56316)
Signed-off-by: Thang Nguyen <thang.nguyen@inferact.ai>
Co-authored-by: Thang Nguyen <thang.nguyen@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Kimi Code <noreply@moonshot.ai>
|
2026-09-17 14:11:40 -07:00 |
|
|
Maroon AyoubandRobert Shaw
|
9612f77077
|
[Bugfix] Release stale FlashMLA workspace views after growth (#56902)
Signed-off-by: Maroon Ayoub <mayoub@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-09-17 16:23:15 -04:00 |
|
|
rasmithandShanshan Shen
|
acc2ed2a5f
|
[ROCm][CI][The Rock 10] Fix (MI355) Quantized Models failure on The Rock 10 with Triton 3.8.x (#54849)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-17 15:20:35 -05:00 |
|
|
Doug Brown
|
2b02c6c29b
|
[Model] Add Cohere2MoE Eagle3 auxiliary hidden states (#49819)
Signed-off-by: Doug Brown <doug@github.douggo.com>
|
2026-09-17 20:09:36 +00:00 |
|
|
Misha Goin
|
9a5bd373cf
|
[CI] Retire Weight Loading smoke tests (#57398)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-17 16:04:03 -04:00 |
|