 Rebecca LeeandCursor
|
6ca2b23e22
|
[ROCm] Expose kFp8DynamicTokenSym on AITER PTPC linears (#54248)
Signed-off-by: Rebecca Lee <rebecca.lee@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-16 11:48:30 -05:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
Nicolò Lucchesi
|
804e5377aa
|
[Bugfix][HiSparse][PD] Align region-mapped pulls across logical block sizes (#57077)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-16 18:39:07 +02:00 |
|
|
Robert ShawandClaude
|
42919b49c5
|
[P/D] Report prefill worker cache hits in prompt_tokens_details (#54222)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-16 15:23:31 +00:00 |
|
|
|
dff1bde84d
|
[Model] Qwen4Exp: fp8_e4m3 main KV cache on the QSA path (#55557)
Signed-off-by: Andrea Semeraro <andrea.semeraro@sezione1.it>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-09-16 15:07:52 +00:00 |
|
|
|
e97ff80613
|
[BugFix][PCP] Handle missing DP metadata in one-sided EP (#54016)
Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-16 10:24:59 -04:00 |
|
|
linitra24
|
ca542ee154
|
[Model][LoRA] Enable LoRA support for ModernBertModel (#57148)
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-09-16 14:16:09 +00:00 |
|
|
linitra24andJee Jee Li
|
c81eb3e69c
|
[LoRA] Support modules_to_save for sequence classification (#53555)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-16 07:15:42 -07:00 |
|
|
|
ec4a3a5370
|
[CI] Bump Transformers version to 5.17.0 (#56108)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-16 06:34:16 -07:00 |
|
|
sashko-zakharchukandzjy0516
|
f8b5c11468
|
[Bugfix][Kimi-K3] Do not classify a stateless first chunk as a decode (#51483)
Signed-off-by: Oleksandr Zakharchuk <oleksandr.zakharchuk@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-09-16 21:24:48 +08:00 |
|
|
|
975dca5bb5
|
[Perf][GDN] Scatter mixed speculative outputs into the caller buffer (#57140)
Signed-off-by: Arpan Tripathi <tripathiarpan20@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Xavier Lyu <9938360+xavierlyu@users.noreply.github.com>
Co-authored-by: Bohdan Podziubanchuk <114604629+Danbog32@users.noreply.github.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 13:03:57 +00:00 |
|
|
Nicolò Lucchesi
|
8b1d188046
|
[Bugfix][Mooncake] Report request-level KV load failures under HMA (#56855)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-16 14:55:40 +02:00 |
|
|
|
903285fbcc
|
[Bugfix] Let an optional Literal flag accept the None it advertises (#52370)
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-16 12:14:54 +00:00 |
|
|
Harshit KediaandClaude Opus 5
|
6a2fdf9ac6
|
[Model] Optimize Sarvam MLA routing and preserve FP32 router logits (#56034)
Signed-off-by: Harshit Kedia <harshit@sarvam.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 20:02:47 +08:00 |
|
|
Flora Feng
|
3bb7826214
|
[Agent] Add agent instructions for parser directories (#56883)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-16 06:55:26 -04:00 |
|
|
wangxiyuanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
118e17f5ff
|
[Platform] Move env check function to platform interface (#48599)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-16 10:08:36 +00:00 |
|
|
|
d6a1677d55
|
[Model][DSv4.1] FlashMLA mega attention and the NVFP4 compressed KV cache (#56935)
Signed-off-by: Yongye Zhu <yongye@inferact.ai>
Signed-off-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Yunxiao Ning <73625538+foraxe@users.noreply.github.com>
Co-authored-by: AI Assistant <noreply@openai.com>
|
2026-09-16 03:07:50 -07:00 |
|
|
Adababyandshaolila
|
ceb87de065
|
[Misc] Remove no-op self-assignments across vLLM (#55988)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-16 02:17:07 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
5f203baedb
|
[Docs] Split slash-combined docstring parameters (#57141)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 02:16:32 -07:00 |
|
|
Ganesh RandCursor
|
82731931ae
|
[Bugfix][CPU] Fall back to CpuPlatform when zentorch fails to import (#54923)
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-16 17:15:12 +08:00 |
|
|
Canlin GuoandCodex
|
03f67b3ad1
|
[Perf][DSV4.1] Pad shared experts for native MegaMoE fusion (#56568)
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 17:08:42 +08:00 |
|
|
Misha Goin
|
0384e72693
|
[UX] Add thinking support to vllm chat (#57045)
|
2026-09-16 09:54:10 +01:00 |
|
|
|
35f6047c1a
|
[XPU][Bugfix] Fix Qwen2-Audio ValueError on audio clips longer than 30s (#56912)
Signed-off-by: Jakub Byczkowski <jakub.byczkowski@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-16 16:54:02 +08:00 |
|
|
|
f37c550bf6
|
[Feature][Frontend] Expose effective attention block size for DCP (#56538)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-16 08:29:43 +00:00 |
|
|
wenjinhust
|
0d8173d153
|
[Bugfix][Frontend] Lazy-import model_hosting_container_standards to prevent log suppression (#51366)
Signed-off-by: wenjinhust <wenjin.sh@huawei.com>
|
2026-09-16 08:25:49 +00:00 |
|
|
dev
|
8be5205abb
|
[Parser] Fix: correct parser frontend handling of reasoning end and boundary tokens (#56635)
Signed-off-by: DEV TYAGI <devtyagi3909@gmail.com>
|
2026-09-16 01:17:22 -07:00 |
|
|
Ama Senevirathneandamasen02
|
9ca6dbba71
|
fix(multimodal): tolerate malformed EXIF metadata during hashing (#56527) (#56576)
Signed-off-by: amasen02 <amasen02@users.noreply.github.com>
Co-authored-by: amasen02 <amasen02@users.noreply.github.com>
|
2026-09-16 07:56:50 +00:00 |
|
|
Li, Jiang
|
b68408043d
|
[Bugfix][CPU] Add per-tensor FP8 W8A16 kernel to fix Ministral crash on CPU (#56985)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-16 15:49:17 +08:00 |
|
|
MINJUN GILandOr Ozeri
|
f12fe10c5c
|
[Bugfix][KV Offload] Track cache recency once per request (#51787)
Signed-off-by: mindungil <alswnsrlf12@naver.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-16 10:47:26 +03:00 |
|
|
|
ab35354c21
|
[ROCm][AITER] Skip AITER norm kernels when flattening to 2D would copy (#55991)
Signed-off-by: Zheng Gong <zgong@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-09-16 07:26:56 +00:00 |
|
|
Wei Zhao
|
f30a195bbb
|
[Bugfix] Fix incorrect Mamba block allocation estimate that prevents request admission (#57050)
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-09-16 07:23:20 +00:00 |
|
|
|
18553c5c9f
|
[Kernel] Use Murmur3 RNG for Gumbel sampling (#51367)
Signed-off-by: freyfwt <110148731+freyfwt@users.noreply.github.com>
Signed-off-by: freyfwt <freytian1996@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-09-15 23:52:26 -07:00 |
|
|
|
0f8fa53acf
|
[Bugfix][KV Offload] Check cgroup memory before SHM allocation (#54014)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Signed-off-by: AlexHuang <alex.tech.lab@outlook.com>
Signed-off-by: Alex <alex.tech.lab@outlook.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
|
2026-09-16 09:17:50 +03:00 |
|
|
shaohuaxiandCodex
|
e0301afb2a
|
[Bugfix][Responses] Clean up MCP tool sessions once before closing them (#56988)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 14:07:06 +08:00 |
|
|
MattandAndreas Karatzas
|
b3b13c1292
|
[ROCm][CI] Fix MLA RoPE fused-kernel tests for TheRock image (#57112)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-16 05:57:40 +00:00 |
|
|
|
323a29d8f2
|
[Bugfix] Unreadable prompt_embeds payload should be a 400, not a 500 (#55451)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-16 05:53:36 +00:00 |
|
|
Jiangyun ZhuandTJian
|
4fe9e6f6e5
|
[Refactor][GLM-5.3-Flash] Move sparse_attn_indexer_kpool into the model folder and split AMD/NVIDIA (#55358)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-09-16 05:50:35 +00:00 |
|
|
|
961c5b6b7e
|
[Bugfix][KV Offload] Restore MTP-retained sliding-window history (#56709)
Signed-off-by: jacklin78911-collab <jacklin78911@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-16 08:14:09 +03:00 |
|
|
Andreas KaratzasandCodex
|
711768fc17
|
[CI][ROCm] Add opt-in TheRock builds for AMD CI (#56351)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 00:09:45 -05:00 |
|
|
|
af1c01499b
|
[Bugfix] Make GPU sync checks safe under torch.compile (#56904)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-15 21:37:08 -07:00 |
|
|
|
6ecd97f1b7
|
[Perf][DSpark] Add KV-only context insertion across V4.1 cache formats (#56441)
Signed-off-by: 0z5a <0z5a@users.noreply.github.com>
Signed-off-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: 0z5a <0z5a@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-15 21:34:55 -07:00 |
|
|
danisereb
|
a31ec3a68b
|
[LoRA][Nemotron] Add LoRA support for Nemotron VL models (for the language model only) (#56231)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
|
2026-09-15 21:20:28 -07:00 |
|
|
alberto
|
75dc588269
|
[KV Offload] Add per-request max_load_tokens control (#55885)
Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
|
2026-09-16 06:57:38 +03:00 |
|
|
Chaojun ZhangandKunshang Ji
|
622934e61f
|
[XPU] Honor device_ids for worker device placement (#56015)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-16 11:53:23 +08:00 |
|
|
IslamandBugen Zhao
|
c16bb6068f
|
[Bugfix][Rust Frontend] Tolerate NaN-corrupted logprobs in engine-core (#51026)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Islam <islam.almersawi@openinnovation.ai>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-16 03:10:58 +00:00 |
|
|
Marceli FylcekandKunshang Ji
|
ccbaed5b91
|
[XPU] Route to fused_qk_rmsnorm_rope_gate triton kernel (#56096)
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-16 11:05:54 +08:00 |
|
|
Qiming ZhangandKunshang Ji
|
4ace5cd9d8
|
[XPU] fix_test_worker_memory_snapshot_for_xpu (#50097)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-16 11:05:43 +08:00 |
|
|
|
fdfcbbcac7
|
[CI/Build][Rust Frontend] Retire Buf schema publishing (#57046)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
|
2026-09-16 03:02:25 +00:00 |
|
|
maithilijoshi20
|
22bb158c21
|
[Bugfix][ROCm] Fix MiniMax-M3 fused MXFP8 block scale (#53674)
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
|
2026-09-15 21:59:43 -05:00 |
|
|
Bugen Zhao
|
bfd713bf8b
|
[Rust Frontend] Support HF config overrides --hf-overrides (#56931)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-16 02:52:55 +00:00 |
|