 Juan Pérez de Algaba
|
d83eb0b36b
|
fix(security): classify DeepStream as GPU backend and enforce pixel limits (#50755)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-03 08:23:09 +00:00 |
|
|
Jee Jee Li
|
4635cc3e8f
|
Shard the K3 Latent-MoE up-projection on large batches (#50383)
|
2026-08-03 00:49:39 -07:00 |
|
|
|
0a6446005d
|
[CPU] Migrate unquantized MoE to the modular-kernel experts structure (#50133)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-08-03 14:55:04 +08:00 |
|
|
Cyrus Leung
|
b3f97dae24
|
[Frontend] Require cache_salt to be non-empty via schema (#50816)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-03 06:51:27 +00:00 |
|
|
zofiaandKunshang Ji
|
e481da9508
|
[XPU] [Linear] add torch as xpu linear backend (#49664)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-03 14:30:21 +08:00 |
|
|
Qiming Zhang
|
2755489a26
|
[INC] fix w4a4 model (#50807)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-03 14:28:58 +08:00 |
|
|
|
f5bb701fa2
|
[Bugfix][Frontend] Constrain Anthropic cache_salt to non-empty (#50764)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-03 13:33:14 +08:00 |
|
|
YAMAMOTO Takashi
|
5e35a6f4f9
|
cpu_model_runner.py: skip the warm up if CompilationMode.NONE (#50547)
Signed-off-by: YAMAMOTO Takashi <yamamoto@midokura.com>
|
2026-08-03 04:34:29 +00:00 |
|
|
Yifan Qiaoandxijiade.aihemaiti
|
5c4fe4b17e
|
[Bugfix][KV Connector] Propagate EAGLE state across merged Mooncake store groups (#49069)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xijiade.aihemaiti <3146335281@qq.com>
|
2026-08-02 19:32:26 -07:00 |
|
|
Omkar Shewale
|
9a4fd57cac
|
[Model] Support jina-embeddings-v5-text-nano (EuroBERT encoder backbone) (#50688)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
|
2026-08-03 01:37:08 +00:00 |
|
|
Jason Li
|
0055b8bfa3
|
[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032)
|
2026-08-02 13:46:55 -07:00 |
|
|
Fangzhou AiandOpenAI Codex
|
c666810676
|
[ROCm][Bugfix][Kimi-K3] Preserve MoE correction bias in FP32 (#50761)
Signed-off-by: Fangzhou Ai <Fangzhou.Ai@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-02 20:30:54 +00:00 |
|
|
Taneem Ibrahim
|
55c98e370a
|
[Model Runner v2] Enable BGE M3 pooling embed token_classify (#50661)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-02 12:46:03 -04:00 |
|
|
Itay Alroy
|
96add737ff
|
[Elastic EP] Fix non-contiguous weight transfers (#50641)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
|
2026-08-02 11:13:42 -04:00 |
|
|
Rafli Surya Wijayaandloulanyue
|
0601850791
|
[Bugfix][Models] Accept Qwen3_5MoeTextConfig in Qwen3_5MoeProcessingInfo for transformers 5.x compatibility (#50704)
Signed-off-by: loulanyue <loulanyue@users.noreply.github.com>
Co-authored-by: loulanyue <loulanyue@users.noreply.github.com>
|
2026-08-02 05:50:40 +00:00 |
|
|
Isotr0pyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e2fa28594f
|
[1/N] Unify multiple-path encoder cuda graph support (#49934)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-02 10:33:23 +08:00 |
|
|
Woosuk Kwon
|
38a466e7b6
|
[DSV4] Implement Sequence Parallelism (#46789)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-01 10:22:33 -07:00 |
|
|
yzong-rh
|
dc818c198d
|
[GPT-OSS] Strict tool call and constrained decoding for Harmony (#45560)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-01 12:10:26 -04:00 |
|
|
Ning Xie
|
03c782eb91
|
[model registry] some simple typos (#50673)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-01 15:37:29 +00:00 |
|
|
Almog Tavor
|
39f55ffdaa
|
[Core] Offload raw-prompt preprocessing to renderer thread pool in AsyncLLM (#49608)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-01 15:10:51 +00:00 |
|
|
Guan-Ming Chiu
|
63e78ce365
|
[Benchmark] Add probe requests to vllm bench serve (#49611)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-08-01 22:10:56 +08:00 |
|
|
Taneem Ibrahim
|
652ba59229
|
[Model Runner V2] Enable encoder token embedding (#50574)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-01 07:55:36 -04:00 |
|
|
Jeff (Junze) MaandYifan Qiao
|
3986b967b2
|
(feat): optionally disable lookup on PD decode (#50498)
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-01 09:41:43 +00:00 |
|
|
Cao Qian
|
81a42d37b1
|
[Frontend] Add cache_salt support to Anthropic Messages API (#49498)
Signed-off-by: aeon-x <talexcao@gmail.com>
|
2026-08-01 07:36:42 +00:00 |
|
|
Matt Qinandyudigege86
|
77469c9057
|
[ROCm][MLA] Mask the AITER MLA small-head verify flatten causally (#50476)
Signed-off-by: yudigege86 <naqin@amd.com>
Co-authored-by: yudigege86 <naqin@amd.com>
|
2026-08-01 07:17:17 +00:00 |
|
|
andrewbcohereandCyrus Leung
|
9c110fa522
|
[Frontend] Cohere chat v2 api support (#47189)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-07-31 22:53:54 -07:00 |
|
|
Chauncey
|
6c91de3689
|
[Bugfix][Parser] Forward model_config to nested reasoning parsers (#50642)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-01 13:07:34 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
f7097a92fd
|
[Bugfix][CI] Prevent common ops imports from initializing CUDA (#50639)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-01 00:13:29 -04:00 |
|
|
|
fcdc7c2e9c
|
[CI] Organize speculative decoding E2E tests by coverage (#50330)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 18:05:42 -07:00 |
|
|
|
e3be89673d
|
Enable ModelOpt FP8 emulation on SM80 (#50019)
Signed-off-by: Mike G <180722391+mikekg@users.noreply.github.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 14:48:27 -07:00 |
|
|
|
454ea5b526
|
[MoE Refactor] Combine CompressedTensorsWNA16MarlinMoEMethod with CompressedTensorsWNA16MoEMethod (#44570)
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Dobrzyniewicz, Agata <agata.dobrzyniewicz@intel.com>
Signed-off-by: Tushar Jain <tushar00jain@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Agata Dobrzyniewicz <160237065+adobrzyn@users.noreply.github.com>
Co-authored-by: Tushar Jain <8455015+tushar00jain@users.noreply.github.com>
Co-authored-by: Tushar Jain <tushar00jain@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-07-31 14:13:03 -07:00 |
|
|
Ning Xie
|
0c4dc7c488
|
[graceful shutdown] fix http server start firstly before app signal handler register (#49668)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-07-31 20:51:33 +00:00 |
|
|
Michael GoinandOpenAI Codex
|
90329913e9
|
[UX] Reduce startup log noise (#50590)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-31 13:04:34 -07:00 |
|
|
yzong-rhandBen Browning
|
e8b358b4c0
|
[Bugfix][Responses] Add tests for Chat Completions Responses API Render Parity (#50334)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-07-31 15:45:40 -04:00 |
|
|
AdrianandClaude
|
4fdd3e0b74
|
[ROCm][ViT] Detect Triton-AMD kernels at their new aiter location (#40289)
Signed-off-by: Adrian Kurt <info@zzit.ch>
Signed-off-by: Adrian <info@zipfuzapfu.ch>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 15:30:09 -04:00 |
|
|
Ning Xie
|
9a7ae4b808
|
[chore] log process manager shutdown with more details (#49437)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-07-31 11:55:09 -07:00 |
|
|
Ning Xie
|
726ef437a1
|
[chore] delete useless code (#49424)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-07-31 11:54:08 -07:00 |
|
|
Soila KavulyaandClaude
|
aef85aed5d
|
[Bugfix][TurboQuant] Add KV quant mode for turboquant (#50533)
Signed-off-by: Soila Kavulya <soila.p.kavulya@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 17:42:32 +00:00 |
|
|
fxmarty-amd
|
e67a2e0a56
|
[ROCm][Quark][7/N] Use MXFP4 linear kernel abstraction for emulation backend (#48949)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-07-31 10:07:15 -07:00 |
|
|
Kyle Sayers
|
d87d2ca747
|
[Compressed-Tensors] Support Kimi-K3 quantized models (#50500)
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
|
2026-07-31 17:06:30 +00:00 |
|
|
Andreas Karatzas
|
8d8a4e0f2b
|
[ROCm][CI] Restore Mistral tool-parser compatibility after unification (#50515)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-31 16:32:43 +00:00 |
|
|
Matthew Bonanni
|
a0cd2b69b3
|
[Bugfix] Universally align block table width to 128 tokens (#50302)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-31 08:52:17 -07:00 |
|
|
|
94e9ef0768
|
[Bugfix] Don't transpose fused MoE quantization scales in RoutedExperts.load_weights (#50137)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 08:46:52 -07:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
df71917cf1
|
[DSv4 Perf] Optimize workspace reuse for eager break, 3.9% E2E TTFT improvement. (#49236)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 08:45:58 -07:00 |
|
|
Andreas Karatzas
|
5233368dac
|
[ROCm][CI] Fall back to lossless Kimi K3 MXFP4 emulation on gfx942 (#50516)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-31 11:33:16 -04:00 |
|
|
Matthew BonanniandOpenAI Codex
|
82ae4164ee
|
[2/N][Attention] Enable masked MHA for sparse MLA prefills (#48770)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-31 06:01:24 -07:00 |
|
|
Recoordinateandlatent-9
|
0b5b49dde8
|
[Bugfix][Frontend] Raise VLLMValidationError for user-facing errors in chat_utils.py (#50491)
Signed-off-by: latent-9 <296084221+latent-9@users.noreply.github.com>
Co-authored-by: latent-9 <296084221+latent-9@users.noreply.github.com>
|
2026-07-31 11:54:43 +00:00 |
|
|
wang.yuqi
|
f5ffc59b6a
|
[Renderer] Warm up the renderer properly. (#50408)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-31 11:46:53 +00:00 |
|
|
|
2c4d348848
|
[KV Connector] Add per-layer canonical KV page mappings for parallelism-agnostic offload (#48408)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Itay Etelis <Itay.etelis@gmail.com>
|
2026-07-31 14:42:54 +03:00 |
|
|
Martin Hickey
|
b2fb83e7ff
|
[Attention]: Use KVCacheSpec for AttentionMetadataBuilder type hints (#50148)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-07-31 11:20:18 +00:00 |
|