 ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
|
b2db227a7c
|
[Bugfix][R3] Unwrap UniformTypeKVCacheSpecs when selecting the routed-experts KV group (#53240)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
|
2026-08-21 19:13:53 -07:00 |
|
|
stefankoncarevic
|
7f4a1b7e24
|
[Bugfix][ROCM] Fix the MXFP8 block scale exponent (#53110)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-22 01:26:19 +00:00 |
|
|
Lucas Wilkinson
|
8bdc70ec7b
|
[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-08-21 17:47:49 -07:00 |
|
|
Misha Goin
|
9ff7041b55
|
[Bugfix][Spec Decode] Use group geometry for FlashAttention metadata (#53002)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-21 17:07:19 -07:00 |
|
|
Misha Goin
|
a34f2ab70a
|
[Test] Add focused hybrid MTP prefix-cache regressions (#53189)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-21 17:05:39 -07:00 |
|
|
Maroon Ayoub
|
a556f3fccb
|
Forward Anthropic vllm_xargs to sampling params (#53308)
Signed-off-by: Maroon Ayoub <mayoub@redhat.com>
|
2026-08-21 15:23:21 -07:00 |
|
|
andrewbcohere
|
f94dcde5c5
|
Fix Cohere ChatV2 citation and tool handling issues (#52175)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
|
2026-08-21 15:23:17 -07:00 |
|
|
stefankoncarevic
|
f37d5868b9
|
[CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-21 16:17:42 -05:00 |
|
|
Kevin H. LuuandAndreas Karatzas
|
e3f6026503
|
Revert "Remove native Hunyuan V1 and VL implementations" (#53296)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-21 13:39:58 -07:00 |
|
|
Kevin H. LuuandAndreas Karatzas
|
592e06f2ae
|
Revert "[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill" (#53294)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-21 13:34:13 -07:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
0a3a4f7f35
|
[Bugfix][KV Connector][NIXL] Support PCP producers (#52779)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 16:22:01 -04:00 |
|
|
|
3e47a9a824
|
[CI] Fix MultiConnector accuracy test lifecycle (#53023)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 13:19:19 -07:00 |
|
|
Divakar Verma
|
29b7c2f7d4
|
[ROCm][CI] aiter kernel ops - enable rope test (#52854)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-08-21 15:17:34 -05:00 |
|
|
Andreas Karatzas
|
a0af854f5d
|
[ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-21 13:17:18 -07:00 |
|
|
Divakar Verma
|
b5f7fcc79d
|
[ROCm][CI] Add float16 dtype and unsupported head size tests for paged attention (#53177)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-08-21 15:16:45 -05:00 |
|
|
Andreas Karatzas
|
88eb946cb1
|
[ROCm][CI] Stabilize MI355 FusedMoE test group (#53025)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-21 13:15:25 -07:00 |
|
|
Kevin H. Luu
|
c0ff33404b
|
Revert compile-cache device index regression on CPU (#53304)
|
2026-08-21 16:08:13 -04:00 |
|
|
djramic
|
f15ea66b30
|
[ROCm][Test] Use platform FP8 dtype in ModelOpt FP8_PB_WO test (#53268)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-08-21 15:06:19 -05:00 |
|
|
Wentao Ye
|
e6f35d3c69
|
[DSv4 Perf] Adaptive topk width for dsv4, making #50004 back (#52823)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-21 12:11:45 -07:00 |
|
|
Summer Yang
|
d6c2fec9fd
|
[Cleanup][MLA] Remove FlashInfer DSpark DCP support (#53139)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-21 11:42:52 -07:00 |
|
|
|
d9e0ace7a0
|
[Bugfix][Attention] Fall back to native FlashInfer decode when XQA cannot serve a KV-cache group's head_dim (#53111)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-21 12:41:24 -06:00 |
|
|
vllm-agentandvllm-ci-failure-analyzer
|
ba53da60bb
|
Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)
Co-authored-by: vllm-ci-failure-analyzer <kevin@inferact.ai>
|
2026-08-21 12:39:28 -06:00 |
|
|
|
7a2fdbaac4
|
[K3 Perf] Fuse MXFP4 top-k finalization into latent-tail, ~5% E2E latency reduction (#53152)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 13:29:59 -04:00 |
|
|
Fangzhou Ai
|
fe76112ff2
|
[ROCm][Perf] Optimize DeepSeek V4 C4A top-k with AITER (#52882)
|
2026-08-21 10:00:39 -07:00 |
|
|
Tan Chao
|
1baf372bfc
|
[Frontend] Use VLLMValidationError for batch request URL validation (#50191)
Signed-off-by: Chao Tan <chaos.tc@gmail.com>
|
2026-08-21 09:07:24 -07:00 |
|
|
Frederik Gossen
|
47cd1c8885
|
[Core] Add dynamo_timed tracing for print_readable (#40834)
Signed-off-by: Frederik Gossen <frgossen@meta.com>
|
2026-08-21 09:07:21 -07:00 |
|
|
Juan Pérez de Algaba
|
e00a034ad1
|
(security) fix: enforce decoder prompt-length validation for skip-che… (#46588)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-21 09:07:19 -07:00 |
|
|
Wei-Cheng (Wayne) Chiu
|
b41dc4ec72
|
[Bugfix] Return HTTP 500 for non-streaming generate errors (#49195)
Signed-off-by: WEI CHENG CHIU <waynehacking8@gmail.com>
|
2026-08-21 09:07:17 -07:00 |
|
|
Neil SchemenauerandTyler Michael Smith
|
6dcc5d7cae
|
[Bugfix] Include device index in compile cache paths (#38962)
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-08-21 09:07:16 -07:00 |
|
|
|
463aa5e30f
|
[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill (#52606)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-08-21 09:07:13 -07:00 |
|
|
Tiezhen WANGandOpenAI Codex
|
d53b1c2efc
|
Remove native Hunyuan V1 and VL implementations (#53272)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-21 09:07:10 -07:00 |
|
|
SoluMilken
|
27ec8ac626
|
[Bugfix] Fix MTP draft model using local cache path instead of S3 URL with runai_streamer (#42079)
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
|
2026-08-21 09:07:08 -07:00 |
|
|
|
72aedcc426
|
[DCP] Default query replication for GLM sparse attention (#50382)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-21 09:07:05 -07:00 |
|
|
Hongxia YangandYifan Qiao
|
cd7b7c265a
|
[ROCm] Cpu offload for ROCm 7.13+ to align the hipMemcpyBatchAsync params and perf in 7.14x (#43018)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-21 09:07:03 -07:00 |
|
|
DCo
|
c1d7a3808d
|
[Bugfix] Fix HYV3 shared_mlp prefix for compressed-tensors ignore matching (#48682)
Signed-off-by: Xiaoyi Xu <xu_xiaoyi@hotmail.com>
|
2026-08-21 09:07:01 -07:00 |
|
|
Morrison TurnanskyandTyler Michael Smith
|
1183f04b74
|
[Bugfix] test_batch_inference_correctness now uses batch invariance (#48040)
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-08-21 09:06:59 -07:00 |
|
|
ErenAta16
|
fbb17e780b
|
[Bugfix] Fix six quantization exception messages split across positional args (#50479)
Signed-off-by: ErenAta16 <erena6466@gmail.com>
|
2026-08-21 09:06:56 -07:00 |
|
|
Greg Pereira
|
18aa245a99
|
using existing uvicorn configuration for dp supervisor (#52473)
Signed-off-by: Gregory Pereira <grpereir@redhat.com>
|
2026-08-21 09:06:54 -07:00 |
|
|
Bugen ZhaoandOpenAI Codex
|
08b73d07cc
|
[Frontend] Prevent Kimi K3 reserved markers in response text (#52889)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 09:06:52 -07:00 |
|
|
Russell Bryant
|
6d8cd88e8d
|
[Docs] document cache salting for prefix cache timing side-channel mitigation (#39082)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2026-08-21 09:06:49 -07:00 |
|
|
Lee Yongjunandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
6f74337c47
|
[Bugfix][Spec Decode]Preserve user --speculative-config overrides for speculators-format models (#42376)
Signed-off-by: leeyongjun <jqueen.astro@gmail.com>
Signed-off-by: Lee Yongjun <35302114+elwhyjay@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-08-21 09:06:47 -07:00 |
|
|
yimdevandusberkeley
|
574e6a00ef
|
[Bugfix][Attention] Normalize FlashInfer prefill LSE before merging (#52796)
Signed-off-by: yimdev <5779256+yimdev@users.noreply.github.com>
Co-authored-by: usberkeley <150880684+usberkeley@users.noreply.github.com>
|
2026-08-21 11:31:14 -04:00 |
|
|
Luke Alonsoandmgoin
|
2740c817ff
|
[Kernel] Add b12x FP4 MoE backend (#52018)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-08-21 08:04:36 -07:00 |
|
|
Frederik GossenandClaude
|
5ee84d3c52
|
[CI][Bugfix] Use a prompt that survives offload-resume rounding in mamba offload test (#53146)
Signed-off-by: Frederik Gossen <frgossen@meta.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-21 10:14:52 -04:00 |
|
|
shijuzhaoandshijuzhao
|
cda3868f5d
|
[Bugfix] Deterministic MoE combine (reduce_scatterv) under VLLM_BATCH_INVARIANT (#45683)
Signed-off-by: shijuzhao <shijuzhao@tencent.com>
Co-authored-by: shijuzhao <shijuzhao@tencent.com>
|
2026-08-21 21:41:31 +08:00 |
|
|
Harish Gaikwad
|
c8438a3d40
|
[Doc] Fix dead link in KV transfer README (#53230)
Signed-off-by: hagaikwa-redhat <hagaikwa@redhat.com>
|
2026-08-21 12:03:41 +00:00 |
|
|
Shuai ShaoandJee Jee Li
|
a60c66e3dc
|
[Bugfix] Fix int32 index overflow in LoRA punica kernels at long context (#53034)
Signed-off-by: Shuai Shao <ss@rungalileo.io>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-21 10:37:06 +00:00 |
|
|
Yan Ma
|
6feafb8b7d
|
[XPU] follow cuda path for mrope on XPU (#53201)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-21 10:13:27 +00:00 |
|
|
linitra24
|
e85d1b69cf
|
[Bugfix][LoRA] Use an explicit capability flag for tower connector LoRA (#53092)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-21 09:45:54 +00:00 |
|
|
xiangdongandKunshang Ji
|
36bad1b90c
|
[XPU][CI]Add more cases in intel GPU CI and reorganize to align non-xpu part (#51630)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-21 09:31:25 +00:00 |
|