|
952694e384
|
[Bugfix] Validate NIXL speculative config compatibility (#49230)
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
Co-authored-by: GPT-5.6 Sol <noreply@openai.com>
Co-authored-by: Cursor Grok 4.5 <noreply@cursor.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-04 02:51:04 +08:00 |
|
|
Almog Tavor
|
65cf1276a2
|
[Kernel] Skip fully masked key blocks in windowed Triton prefill (#50776)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-03 18:48:47 +00:00 |
|
|
Andreas Karatzas
|
76d995df2c
|
[CI][ROCm] Export Helion benchmark script in test artifacts (#50726)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-03 13:09:44 -05:00 |
|
|
|
f0de1a604c
|
[Bugfix] Shard UniformTypeKVCacheSpecs block table width under DCP (#50823)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-08-03 17:34:29 +00:00 |
|
|
|
5df9999fcf
|
[Kimi-K3] Add option to shard the shared expert instead of replicating (#50656)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-03 11:41:24 -04:00 |
|
|
wangxiyuan
|
dd11df04f3
|
[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2026-08-03 11:15:13 -04:00 |
|
|
Wentao Ye
|
0cf49a5d15
|
[Refactor] Remove multiple dead codes (#50285)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-03 10:59:08 -04:00 |
|
|
Benjamin Chislett
|
68ca6fd02c
|
[Bugfix] Remove bad startup assertion (#50869)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-08-03 14:21:50 +00:00 |
|
|
Nicolò Lucchesi
|
8ba87e0181
|
[CI] Mooncake PD integration tests (#46844)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-03 06:55:51 -07:00 |
|
|
Fede KamelharandHarry Mellor
|
005fa01756
|
docs: document reasoning_content output removal as a breaking client change (#50624)
Signed-off-by: fede-kamel <fkamelhar@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-03 13:45:23 +00:00 |
|
|
Kyungmin Leeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9ae11a6b89
|
[Model] Add K-EXAONE-2.0-750B-A37B (#50524)
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-03 06:33:02 -07:00 |
|
|
|
b977407d8b
|
Support quantized DSpark Markov heads (#50424)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-08-03 05:35:39 -07:00 |
|
|
Nicolò LucchesiandClaude
|
ad0bf3963e
|
[CI] KimiLinear PD in nightlies (#50266)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-03 20:20:41 +08:00 |
|
|
|
ec40f6a8a6
|
[CPU] Fix torch.compile crash from torch.accelerator.synchronize on CPU-only hosts (#49960)
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-03 19:48:48 +08:00 |
|
|
Jiangyun Zhu
|
32c42c4f2f
|
[UX] remove torch compile warning when using breakable cudagraph (#50750)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-08-03 11:25:49 +00:00 |
|
|
wang.yuqi
|
9acb7b3699
|
[CI] And PPL test for multimodal generation models (#50839)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-03 11:25:08 +00:00 |
|
|
Li, Jiang
|
c8602c7906
|
[CPU] Refine CPU kernel dispatch (#50801)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-03 17:42:53 +08:00 |
|
|
Jee Jee Li
|
b9d1e2437e
|
K3: Move LatentMoERunner (#50678)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-03 09:36:17 +00:00 |
|
|
Christopher MiyaiandHarry Mellor
|
d9dac2b3d4
|
fix: remove stray duplicate from serving benchmark config (#46870)
Signed-off-by: cmiyai <cmiyai@bu.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-03 08:34:12 +00:00 |
|
|
Hareesh GaliandClaude Fable 5
|
89ac407e3d
|
[Perf] Speed up multimodal placeholder and token-match scanning (#50716)
Signed-off-by: Hareesh <hgsata@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-03 08:27:56 +00:00 |
|
|
Juan Pérez de Algaba
|
d83eb0b36b
|
fix(security): classify DeepStream as GPU backend and enforce pixel limits (#50755)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-03 08:23:09 +00:00 |
|
|
Jee Jee Li
|
4635cc3e8f
|
Shard the K3 Latent-MoE up-projection on large batches (#50383)
|
2026-08-03 00:49:39 -07:00 |
|
|
|
0a6446005d
|
[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-08-03 14:55:04 +08:00 |
|
|
Cyrus Leung
|
b3f97dae24
|
[Frontend] Require cache_salt to be non-empty via schema (#50816)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-03 06:51:27 +00:00 |
|
|
zofiaandKunshang Ji
|
e481da9508
|
[XPU] [Linear] add torch as xpu linear backend (#49664)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-03 14:30:21 +08:00 |
|
|
Qiming Zhang
|
2755489a26
|
[INC] fix w4a4 model (#50807)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-03 14:28:58 +08:00 |
|
|
|
f5bb701fa2
|
[Bugfix][Frontend] Constrain Anthropic cache_salt to non-empty (#50764)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-03 13:33:14 +08:00 |
|
|
YAMAMOTO Takashi
|
5e35a6f4f9
|
cpu_model_runner.py: skip the warm up if CompilationMode.NONE (#50547)
Signed-off-by: YAMAMOTO Takashi <yamamoto@midokura.com>
|
2026-08-03 04:34:29 +00:00 |
|
|
Yifan Qiaoandxijiade.aihemaiti
|
5c4fe4b17e
|
[Bugfix][KV Connector] Propagate EAGLE state across merged Mooncake store groups (#49069)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xijiade.aihemaiti <3146335281@qq.com>
|
2026-08-02 19:32:26 -07:00 |
|
|
Turner JabbourandClaude
|
e42c230e4f
|
[Bugfix] serving_llama70B_tp4 benchmark was silently running at tensor_parallel_size=1 (#50766)
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-03 02:26:48 +00:00 |
|
|
Omkar Shewale
|
9a4fd57cac
|
[Model] Support jina-embeddings-v5-text-nano (EuroBERT encoder backbone) (#50688)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
|
2026-08-03 01:37:08 +00:00 |
|
|
chun-wan
|
0033211c0b
|
[Test][V1] Add sleep/wake correctness regression test for hybrid GDN/… (#44972)
Signed-off-by: chun-wan <chun-wan@amd.com>
|
2026-08-02 22:02:42 +00:00 |
|
|
Jason Li
|
0055b8bfa3
|
[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032)
|
2026-08-02 13:46:55 -07:00 |
|
|
Fangzhou AiandOpenAI Codex
|
c666810676
|
[ROCm][Bugfix][Kimi-K3] Preserve MoE correction bias in FP32 (#50761)
Signed-off-by: Fangzhou Ai <Fangzhou.Ai@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-02 20:30:54 +00:00 |
|
|
Taneem Ibrahim
|
55c98e370a
|
[Model Runner v2] Enable BGE M3 pooling embed token_classify (#50661)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-02 12:46:03 -04:00 |
|
|
Itay Alroy
|
96add737ff
|
[Elastic EP] Fix non-contiguous weight transfers (#50641)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
|
2026-08-02 11:13:42 -04:00 |
|
|
Rafli Surya Wijayaandloulanyue
|
0601850791
|
[Bugfix][Models] Accept Qwen3_5MoeTextConfig in Qwen3_5MoeProcessingInfo for transformers 5.x compatibility (#50704)
Signed-off-by: loulanyue <loulanyue@users.noreply.github.com>
Co-authored-by: loulanyue <loulanyue@users.noreply.github.com>
|
2026-08-02 05:50:40 +00:00 |
|
|
Isotr0pyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e2fa28594f
|
[1/N] Unify multiple-path encoder cuda graph support (#49934)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-02 10:33:23 +08:00 |
|
|
bnellnm
|
c67fe497a2
|
[Bugfix][Doc] Fix references to FusedMoE in doc (#50701)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-08-02 09:13:06 +08:00 |
|
|
Woosuk Kwon
|
38a466e7b6
|
[DSV4] Implement Sequence Parallelism (#46789)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-01 10:22:33 -07:00 |
|
|
yzong-rh
|
dc818c198d
|
[GPT-OSS] Strict tool call and constrained decoding for Harmony (#45560)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-01 12:10:26 -04:00 |
|
|
Hongxia Yang
|
127a7cebc9
|
Add @hongxiayang as code owner for AMD-specific model files and ROCm docs (#50608)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
|
2026-08-01 09:02:44 -07:00 |
|
|
Ning Xie
|
03c782eb91
|
[model registry] some simple typos (#50673)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-01 15:37:29 +00:00 |
|
|
Almog Tavor
|
39f55ffdaa
|
[Core] Offload raw-prompt preprocessing to renderer thread pool in AsyncLLM (#49608)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-01 15:10:51 +00:00 |
|
|
Guan-Ming Chiu
|
63e78ce365
|
[Benchmark] Add probe requests to vllm bench serve (#49611)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-08-01 22:10:56 +08:00 |
|
|
xiaolinchen
|
ab06486175
|
[Bugfix][Kernel] Fix dangling temporary in AWQ gemm torch::stable::sum dim arg (#46805)
Signed-off-by: wentian-byte <2990624738@qq.com>
|
2026-08-01 09:56:55 -04:00 |
|
|
Taneem Ibrahim
|
652ba59229
|
[Model Runner V2] Enable encoder token embedding (#50574)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-01 07:55:36 -04:00 |
|
|
Jeff (Junze) MaandYifan Qiao
|
3986b967b2
|
(feat): optionally disable lookup on PD decode (#50498)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-01 09:41:43 +00:00 |
|
|
Cao Qian
|
81a42d37b1
|
[Frontend] Add cache_salt support to Anthropic Messages API (#49498)
Signed-off-by: aeon-x <talexcao@gmail.com>
|
2026-08-01 07:36:42 +00:00 |
|
|
Matt Qinandyudigege86
|
77469c9057
|
[ROCm][MLA] Mask the AITER MLA small-head verify flatten causally (#50476)
Signed-off-by: yudigege86 <naqin@amd.com>
Co-authored-by: yudigege86 <naqin@amd.com>
|
2026-08-01 07:17:17 +00:00 |
|