zhaozx-cn
433c0f8675
[Model] Fix bailing_moe accuracy problem ( #28277 )
...
Signed-off-by: zhaozx-cn <zhaozx2116@163.com >
2025-11-14 13:33:02 +00:00
Lucas Wilkinson
db56a59970
[BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) ( #28702 )
2025-11-14 12:19:22 +00:00
Yong Hoon Shin and Cyrus Leung
9324e10275
Fix KV sharing fast prefill with cudagraph enabled ( #28537 )
...
Signed-off-by: Yong Hoon Shin <yhshin@meta.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2025-11-14 11:53:42 +00:00
4516d44b7f
[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer ( #25438 )
...
Signed-off-by: gaojc <1055866782@qq.com >
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com >
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com >
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com >
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com >
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com >
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com >
2025-11-14 11:24:10 +00:00
Shanshan Shen and Isotr0py
41b92f7d38
[Model][MM] Extract conv layer as CustomOp ( #28455 )
...
Signed-off-by: shen-shanshan <467638484@qq.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-11-14 19:16:13 +08:00
360bd8762f
[Frontend] Added chat-style multimodal support to /classify. ( #27516 )
...
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com >
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com >
Signed-off-by: vnadathur <glvikramn@gmail.com >
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com >
Co-authored-by: wang.yuqi <noooop@126.com >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
2025-11-14 11:03:55 +00:00
lyn610
ecf8230d4d
[Metrics] Log number of preempted requests ( #28522 )
...
Add tracking and periodic logging for the number of preempted requests in the
metrics logger. This helps monitor system behavior under load.
Signed-off-by: Yining Liu <610lyn@gmail.com >
2025-11-14 09:47:45 +00:00
Nick Hill
bc3e43069a
[BugFix] Fix multi-modal async scheduling race condition ( #28706 )
...
Signed-off-by: Nick Hill <nhill@redhat.com >
2025-11-14 01:11:13 -08:00
Jiangyun Zhu
c36bcfe6b3
[Bugfix] fix dots.ocr pp support ( #28705 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-14 09:01:26 +00:00
Yan Ma
529cea343d
use default CCL_ZE_IPC_EXCHANGE ( #28700 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2025-11-14 16:55:29 +08:00
15ae8e0784
[Bugfix][CI/Test][Spec Decode] Fix illegal memory access in offline_inference/spec_decode.py (Issue 27619) ( #28432 )
...
Signed-off-by: Randall Smith <ransmith@amd.com >
Co-authored-by: Randall Smith <ransmith@amd.com >
Co-authored-by: TJian <tunjian.tan@embeddedllm.com >
2025-11-13 22:34:01 -08:00
haoyangli-amd
0b25498990
[Misc] add ignore mapper for quark quantization ( #28275 )
...
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com >
2025-11-14 05:56:35 +00:00
Cyrus Leung
01bea115c4
[Misc] Remove warn_for_unimplemented_methods ( #28613 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2025-11-14 11:10:10 +08:00
Hank_ and Michael Goin
4d5943bda6
[quantization][config] enable override existing quant_config ( #28510 )
...
Signed-off-by: Hank <hcc.mayday@gmail.com >
Co-authored-by: Michael Goin <mgoin64@gmail.com >
2025-11-14 01:24:10 +00:00
Wentao Ye
e64011f29a
[CI] Bug: Fix ci entrypoint pooling ( #28684 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2025-11-13 14:19:35 -08:00
Yanan Cao
262d263f6c
[Bugfix] Eliminate tuple inputs to submodules in graph partitioning ( #28533 )
...
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com >
2025-11-13 15:09:05 -05:00
Qiu and gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
968060c15a
[bugfix] correct local_chunk_len for DCP in reorg_kvcache with long context ( #28526 )
...
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-13 11:29:22 -08:00
elvischenv and Nick Hill
5d6ce2b960
[Perf] Support stream interval for reducing host overhead ( #27869 )
...
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com >
Co-authored-by: Nick Hill <nhill@redhat.com >
2025-11-13 13:21:25 -05:00
Matthew Bonanni
f9f3b596f3
[Attention][Bugfix] Fix FA sink support ( #28660 )
...
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
2025-11-13 13:20:01 -05:00
119c4927b3
[Bugfix] Fix validate model input for decoder models ( #27099 )
...
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com >
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com >
Signed-off-by: Michael Goin <mgoin64@gmail.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
2025-11-13 10:18:47 -08:00
Varun Sundar Rabindranath and Varun Sundar Rabindranath
fe1cd7704d
[Performance][B200] silu_mul_quant: pack scales in int32 ( #28358 )
...
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com >
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com >
2025-11-13 10:16:55 -08:00
Nick Hill
327c0a9a23
[BugFix] Ensure EngineArgs.create_engine_config is idempotent ( #28515 )
...
Signed-off-by: Nick Hill <nhill@redhat.com >
2025-11-13 17:14:08 +00:00
Jane (Yuan) Xu
06c4873d95
Rewrite C++ meta funcs to Python ( #28595 )
...
Signed-off-by: Jane Xu <janeyx@meta.com >
2025-11-14 00:52:50 +08:00
Roger Wang
d3387750f1
[Misc] Turn off encoder torch compile by default ( #28634 )
...
Signed-off-by: Roger Wang <hey@rogerw.io >
2025-11-13 08:38:08 -08:00
Harry Mellor and bruceszchen
b230286fbc
Fix get_num_experts when config sets it explicitly to None ( #28652 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: bruceszchen <bruceszchen@tencent.com >
2025-11-13 16:02:42 +00:00
Yuanping Song
3035d1a166
[BugFix] DeepSeek-OCR: apply NoRepeatNGramLogitsProcessor to greedy path ( #28617 )
...
Signed-off-by: Yuanping Song <yuanping.song@outlook.com >
2025-11-13 15:24:35 +00:00
Huamin Li
07a606aa7e
[CI Failure] Fix backend selection for encoder-only models ( #28534 )
...
Signed-off-by: Huamin Li <3ericli@gmail.com >
2025-11-13 10:11:27 -05:00
Pleaplusone
8da2f28f53
[ROCm][BugFix]Fix get_cu_count in rocm_aiter_fa.py ( #28618 )
...
Signed-off-by: ganyi <ygan@amd.com >
2025-11-13 14:18:20 +00:00
zofia
c47b6c85ac
[XPU] add sym params to IPEXConfig ( #28611 )
...
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com >
2025-11-13 11:35:04 +00:00
baonudesifeizhai
c428e8d80b
Fix io processor pooling #28273 ( #28484 )
...
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com >
2025-11-13 11:34:14 +00:00
Zijing Liu
5e973209aa
[BugFix] Fix type error when assign a trition kernel tensor to a torch.nn.Parameter ( #28603 )
...
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com >
2025-11-13 11:30:04 +00:00
Yong Hoon Shin
11ac9ddd03
Support all interleaved layer types ( #28485 )
...
Signed-off-by: Yong Hoon Shin <yhshin@meta.com >
2025-11-13 08:57:20 +00:00
Chauncey
5c9ad138d5
[Frontend] supports interleaved thinking ( #28531 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2025-11-13 16:14:13 +08:00
Jiangyun Zhu
fa183e9271
[Bugfix] fix kimi-linear crash ( #28445 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-13 07:59:58 +00:00
tjandy98
4504e8029b
[Bugfix] Prevent crash on empty grammar string ( #28210 )
...
Signed-off-by: tjandy98 <3953059+tjandy98@users.noreply.github.com >
2025-11-13 06:42:29 +00:00
Pleaplusone
ca00b1bfc6
[ROCm][BugFix] Remove the usage of device_info from aiter ( #28383 )
...
Signed-off-by: ganyi <ygan@amd.com >
2025-11-12 21:43:42 -08:00
Lucia Fang
7e082bc14e
Support DeepEP for Kimi-k2-thinking through enabling gemm selection for compressed-tensor marlin wna16 ( #28574 )
...
Signed-off-by: Lu Fang <fanglu@fb.com >
2025-11-12 21:40:45 -08:00
Fanli Lin
dbbe0c756a
[XPU] Support Triton path for LoRA operations on XPU ( #28511 )
...
Signed-off-by: Fanli Lin <fanli.lin@intel.com >
2025-11-13 05:31:42 +00:00
Pleaplusone
7dca0c90cb
[BugFix][ROCm] Fix get_cu_count missing variable error ( #28608 )
...
Signed-off-by: ganyi <ygan@amd.com >
2025-11-13 05:18:56 +00:00
1a0b157a2e
[Frontend][responsesAPI][1/n] convert responses API tool input to chat completions tool format ( #28231 )
...
Signed-off-by: Andrew Xia <axia@fb.com >
Co-authored-by: Andrew Xia <axia@fb.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2025-11-13 04:47:22 +00:00
Andrew Xia and Andrew Xia
7c38ed0f1c
[Frontend] split append tool output ( #28333 )
...
Signed-off-by: Andrew Xia <axia@fb.com >
Co-authored-by: Andrew Xia <axia@fb.com >
2025-11-13 04:03:23 +00:00
Jialin Ouyang
a1d3866dda
[n-gen] DO NOT repeatedly return finished child requests ( #28591 )
...
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com >
2025-11-13 03:36:07 +00:00
Harry Mellor
97d1c99302
Rename clashing method names for vLLM model protocol ( #27583 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2025-11-12 19:14:33 -08:00
Nick Hill
8832fff972
[BugFix] Fix mm_encoder_attn_backend arg type checking ( #28599 )
...
Signed-off-by: Nick Hill <nhill@redhat.com >
2025-11-13 03:06:03 +00:00
Michael Goin
a543e678b4
[Bugfix] Fix SM100 gpt-oss regression due to faulty attn sink support ( #28561 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
2025-11-12 19:40:59 -07:00
wangxiyuan
2dacd57394
[platform] Move get_cu_count to utils ( #27005 )
...
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-11-13 08:48:47 +08:00
Harry Mellor
51c599f0ec
Skip models that cannot currently init on Transformers v5 ( #28471 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2025-11-12 23:43:57 +00:00
Alexander Matveev
69d0e90313
[MoE][Kernel][Perf] Improve Shared Expert Stream Overlap ( #28406 )
...
Signed-off-by: Alexander Matveev <amatveev@redhat.com >
2025-11-12 23:37:24 +00:00
4ca5cd5740
[Core][AMD] Migrate fully transparent sleep mode to ROCm platform ( #12695 )
...
Signed-off-by: Hollow Man <hollowman@opensuse.org >
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com >
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com >
2025-11-12 15:24:12 -08:00
QiliangCui
3eb0c2673e
[TPU] Support GCS path in VLLM_TORCH_PROFILER_DIR ( #28487 )
...
Signed-off-by: Qiliang Cui <derrhein@gmail.com >
2025-11-12 22:31:14 +00:00
zhaozx-cn