 Hareesh GaliandClaude Fable 5
|
89ac407e3d
|
[Perf] Speed up multimodal placeholder and token-match scanning (#50716)
Signed-off-by: Hareesh <hgsata@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-03 08:27:56 +00:00 |
|
|
Juan Pérez de Algaba
|
d83eb0b36b
|
fix(security): classify DeepStream as GPU backend and enforce pixel limits (#50755)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-03 08:23:09 +00:00 |
|
|
|
0a6446005d
|
[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-08-03 14:55:04 +08:00 |
|
|
Qiming Zhang
|
2755489a26
|
[INC] fix w4a4 model (#50807)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-03 14:28:58 +08:00 |
|
|
|
f5bb701fa2
|
[Bugfix][Frontend] Constrain Anthropic cache_salt to non-empty (#50764)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-03 13:33:14 +08:00 |
|
|
Yifan Qiaoandxijiade.aihemaiti
|
5c4fe4b17e
|
[Bugfix][KV Connector] Propagate EAGLE state across merged Mooncake store groups (#49069)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xijiade.aihemaiti <3146335281@qq.com>
|
2026-08-02 19:32:26 -07:00 |
|
|
Omkar Shewale
|
9a4fd57cac
|
[Model] Support jina-embeddings-v5-text-nano (EuroBERT encoder backbone) (#50688)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
|
2026-08-03 01:37:08 +00:00 |
|
|
chun-wan
|
0033211c0b
|
[Test][V1] Add sleep/wake correctness regression test for hybrid GDN/… (#44972)
Signed-off-by: chun-wan <chun-wan@amd.com>
|
2026-08-02 22:02:42 +00:00 |
|
|
Jason Li
|
0055b8bfa3
|
[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032)
|
2026-08-02 13:46:55 -07:00 |
|
|
Taneem Ibrahim
|
55c98e370a
|
[Model Runner v2] Enable BGE M3 pooling embed token_classify (#50661)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-02 12:46:03 -04:00 |
|
|
Isotr0pyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e2fa28594f
|
[1/N] Unify multiple-path encoder cuda graph support (#49934)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-02 10:33:23 +08:00 |
|
|
Woosuk Kwon
|
38a466e7b6
|
[DSV4] Implement Sequence Parallelism (#46789)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-01 10:22:33 -07:00 |
|
|
yzong-rh
|
dc818c198d
|
[GPT-OSS] Strict tool call and constrained decoding for Harmony (#45560)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-01 12:10:26 -04:00 |
|
|
Guan-Ming Chiu
|
63e78ce365
|
[Benchmark] Add probe requests to vllm bench serve (#49611)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-08-01 22:10:56 +08:00 |
|
|
Taneem Ibrahim
|
652ba59229
|
[Model Runner V2] Enable encoder token embedding (#50574)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-01 07:55:36 -04:00 |
|
|
Jeff (Junze) MaandYifan Qiao
|
3986b967b2
|
(feat): optionally disable lookup on PD decode (#50498)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-01 09:41:43 +00:00 |
|
|
Cao Qian
|
81a42d37b1
|
[Frontend] Add cache_salt support to Anthropic Messages API (#49498)
Signed-off-by: aeon-x <talexcao@gmail.com>
|
2026-08-01 07:36:42 +00:00 |
|
|
Matt Qinandyudigege86
|
77469c9057
|
[ROCm][MLA] Mask the AITER MLA small-head verify flatten causally (#50476)
Signed-off-by: yudigege86 <naqin@amd.com>
Co-authored-by: yudigege86 <naqin@amd.com>
|
2026-08-01 07:17:17 +00:00 |
|
|
andrewbcohereandCyrus Leung
|
9c110fa522
|
[Frontend] Cohere chat v2 api support (#47189)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-07-31 22:53:54 -07:00 |
|
|
Amir Samani
|
c4a4a42d80
|
[Bugfix][Test] Fix monolithic routing replay test buffer capacity (#50640)
|
2026-07-31 19:37:39 -07:00 |
|
|
|
fcdc7c2e9c
|
[CI] Organize speculative decoding E2E tests by coverage (#50330)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 18:05:42 -07:00 |
|
|
|
b40d859c7b
|
[Kernel][Helion] Add numerics checks to benchmark script (#48968)
Signed-off-by: Shangdi Yu <shangdiy@meta.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-31 20:16:02 -04:00 |
|
|
|
454ea5b526
|
[MoE Refactor] Combine CompressedTensorsWNA16MarlinMoEMethod with CompressedTensorsWNA16MoEMethod (#44570)
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Dobrzyniewicz, Agata <agata.dobrzyniewicz@intel.com>
Signed-off-by: Tushar Jain <tushar00jain@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Agata Dobrzyniewicz <160237065+adobrzyn@users.noreply.github.com>
Co-authored-by: Tushar Jain <8455015+tushar00jain@users.noreply.github.com>
Co-authored-by: Tushar Jain <tushar00jain@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-07-31 14:13:03 -07:00 |
|
|
yzong-rhandBen Browning
|
e8b358b4c0
|
[Bugfix][Responses] Add tests for Chat Completions Responses API Render Parity (#50334)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-07-31 15:45:40 -04:00 |
|
|
Ning Xie
|
726ef437a1
|
[chore] delete useless code (#49424)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-07-31 11:54:08 -07:00 |
|
|
Soila KavulyaandClaude
|
aef85aed5d
|
[Bugfix][TurboQuant] Add KV quant mode for turboquant (#50533)
Signed-off-by: Soila Kavulya <soila.p.kavulya@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 17:42:32 +00:00 |
|
|
fxmarty-amd
|
e67a2e0a56
|
[ROCm][Quark][7/N] Use MXFP4 linear kernel abstraction for emulation backend (#48949)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-07-31 10:07:15 -07:00 |
|
|
Matthew Bonanni
|
a0cd2b69b3
|
[Bugfix] Universally align block table width to 128 tokens (#50302)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-31 08:52:17 -07:00 |
|
|
|
94e9ef0768
|
[Bugfix] Don't transpose fused MoE quantization scales in RoutedExperts.load_weights (#50137)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 08:46:52 -07:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
df71917cf1
|
[DSv4 Perf] Optimize workspace reuse for eager break, 3.9% E2E TTFT improvement. (#49236)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 08:45:58 -07:00 |
|
|
Matthew BonanniandOpenAI Codex
|
82ae4164ee
|
[2/N][Attention] Enable masked MHA for sparse MLA prefills (#48770)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-31 06:01:24 -07:00 |
|
|
Nicolò Lucchesi
|
864a87febb
|
[Kernel][CI] --jit-monitor-mode error e2e tests for kernel warmup infra (#50109)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-31 08:53:16 -04:00 |
|
|
Oğuzhan KIR
|
7fdc1ab29e
|
[CI] Remove default_torch_num_threads workaround from llava-onevision-transformers test (#50560)
Signed-off-by: oguz <oguzhankir17@gmail.com>
|
2026-07-31 12:29:31 +00:00 |
|
|
Recoordinateandlatent-9
|
0b5b49dde8
|
[Bugfix][Frontend] Raise VLLMValidationError for user-facing errors in chat_utils.py (#50491)
Signed-off-by: latent-9 <296084221+latent-9@users.noreply.github.com>
Co-authored-by: latent-9 <296084221+latent-9@users.noreply.github.com>
|
2026-07-31 11:54:43 +00:00 |
|
|
|
2c4d348848
|
[KV Connector] Add per-layer canonical KV page mappings for parallelism-agnostic offload (#48408)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Itay Etelis <Itay.etelis@gmail.com>
|
2026-07-31 14:42:54 +03:00 |
|
|
Nicolò Lucchesi
|
17beffd55f
|
[Misc] Clarify mono audio requirement (#50141)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-31 10:46:53 +00:00 |
|
|
bnellnmandHarry Mellor
|
6e311c6e20
|
[MoE Refactor] Rename FusedMoE to FusedMoEFactory (#44941)
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-31 11:28:18 +01:00 |
|
|
Andreas Karatzas
|
c911120a6f
|
[ROCm][CI] Update Transformers AR+RMS fusion expectation (#50517)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-31 11:16:52 +01:00 |
|
|
Chaojun ZhangandKunshang Ji
|
482cfc20f0
|
[XPU] Unify XPU RMSNorm kernels with vllm_c and drop redundant XPU-specific implementation (#46981)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-31 17:28:18 +08:00 |
|
|
Qiming Zhang
|
5d7647a109
|
[UT] add skipif for rocm aiter sampler UT (#50530)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-07-31 16:32:49 +08:00 |
|
|
Thien TranandCodex
|
34bb795ff3
|
[CI] Add M3 MSA tests to CI (#49143)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <noreply@openai.com>
|
2026-07-31 01:01:48 -07:00 |
|
|
|
f727951d3f
|
[Bugfix] Re-land MiniMax M3 default video processor (#50305)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-31 07:46:18 +00:00 |
|
|
|
10e6b40015
|
[CPU][BugFix] Remove redundant kv cache write (#50437)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 15:28:44 +08:00 |
|
|
Isotr0py
|
1180b604f8
|
[Multimodal] Expose mm hash algothrim selection to cli args (#49686)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-31 05:25:19 +00:00 |
|
|
Taneem Ibrahim
|
0f17394564
|
[Model Runner V2] Enable encoder token classification (#50293)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-07-31 04:15:36 +00:00 |
|
|
Sebastian WooandClaude
|
bebf918044
|
[Bugfix][Model] Reject encoder-backbone jina-embeddings-v5 checkpoints with a clear error (fixes #50337) (#50352)
Signed-off-by: seewoo <seewoo@ucsc.edu>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 11:43:31 +08:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
2773ec31b3
|
[ROCm][CI] Use explicit wvSplitKrc skinny-GEMM test tolerance for bf16 (gfx950) (#49309)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 22:25:42 -05:00 |
|
|
Chang GuoandCursor Agent
|
541128bdeb
|
[KV Offload] Enable single-copy MLA layout for CPUOffloadingSpec (#50301)
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: Cursor Agent <cursor-agent@cursor.com>
|
2026-07-31 06:20:47 +03:00 |
|
|
music-dinoandAndreas Karatzas
|
5d5f22ed7a
|
[ROCm][CI] Use larger atol value for INT3 in test_quick_all_reduce.py (#50450)
Signed-off-by: Dino Music <Dino.Music@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 21:41:44 -05:00 |
|
|
MattandAndreas Karatzas
|
d91f7af7d0
|
[Hardware][AMD][Kernel][CI][Bugfix] Fix ROCm DeepEP FP8 max (#50467)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-30 21:37:36 -05:00 |
|