|
382970ee6c
|
[Kimi-K3][AMD] Return KDA and MLA projection outputs directly (#50592)
Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com>
Co-authored-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-21 15:44:41 -05:00 |
|
|
Nils Mattesonandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9fe1cbd463
|
[Docker] Use zstd for CI images and offer a Docker Hub variant (#55608)
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-21 13:40:15 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
12972ae40b
|
[Bugfix][ROCm] Reject unsupported EP for monolithic AITER MXFP4 MoE (#57866)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 15:30:21 -05:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
9179bcd416
|
[Bugfix][MoE] Reject hash routing for unsupported monolithic backends (#57867)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 16:28:35 -04:00 |
|
|
Nicolò Lucchesi
|
54020c3c3e
|
[Engram] Drop redundant VLLM_PLE_CPU_OFFLOAD env var (#57937)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-21 20:16:02 +02:00 |
|
|
Mikko Tukiainenandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
17322375a2
|
[ROCm][Perf] Route the fused shared-expert gate GEMM through the platform dispatcher (#54185)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-21 17:17:55 +00:00 |
|
|
Nicolò Lucchesi
|
fba33e39cb
|
[Docs] Add an Engram feature page explaining Engram usage in vLLM (#57910)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-09-21 17:15:28 +00:00 |
|
|
Karen Chung
|
986e217158
|
[Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)
Signed-off-by: Karen Chung <karenc@nvidia.com>
|
2026-09-21 09:56:11 -07:00 |
|
|
djramicandAndreas Karatzas
|
4f14516790
|
[ROCm][CI] Use ROCm backend for DeepSeek V4.1 ViT test (#57931)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-21 16:39:31 +00:00 |
|
|
Cyrus Leung
|
7853700d4c
|
[MM] Move get_dummy_processor_inputs into MM processor (#57967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-21 09:39:20 -07:00 |
|
|
Sahil PatelandCyrus Leung
|
4e61ad8ee1
|
[Bugfix] unskip InternViT test for transformers v5 compatibility (#55767)
Signed-off-by: sahil <sahil@example.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-21 09:38:25 -07:00 |
|
|
|
874a6b5a06
|
[ROCm] Refactor tuned gemms (#55001)
Signed-off-by: Andy Friedrich <afriedri@amd.com>
Signed-off-by: afriedri <afriedri@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-21 16:30:16 +00:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
8c0825090d
|
[Bugfix][NIXL] Fix DCP pulls across MLA cache regions (#57389)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 11:57:49 -04:00 |
|
|
LucainandClaude Opus 5
|
6b858751f6
|
[docs] Fix legacy hf CLI references (vllm) (#57958)
Signed-off-by: Wauplin <lucainp@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-21 15:32:27 +00:00 |
|
|
Tony Lin
|
dc479a2d83
|
[Bugfix] Fix external LB DP rank handling when replicas share nodes (#53743)
Signed-off-by: Tony Lin <tony.lin@intel.com>
|
2026-09-21 17:19:14 +02:00 |
|
|
Tuukka Sarviandlarryli2-amd
|
e34685dfc0
|
[ROCm][DSv4] Enable DSpark adaptive verification (#52362)
Signed-off-by: Tuukka Sarvi <tuukka.sarvi@amd.com>
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: larryli2-amd <larryli2@amd.com>
|
2026-09-21 10:03:41 -05:00 |
|
|
sfigs
|
21aa17c128
|
[Bugfix][Frontend] Accept diarized transcription responses in run-batch (#57948)
Signed-off-by: Sergio Figueras <sergio@yourecm.com>
|
2026-09-21 14:55:38 +00:00 |
|
|
Taneem Ibrahim
|
887cf91e30
|
[Pooling] Fix normalization of chunked long-text embeddings (#57498)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-21 10:46:39 -04:00 |
|
|
Cyrus Leung
|
c8824a1e42
|
[MM] Move supports_multimodal_inputs and cache out of registry (#57913)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-21 07:43:07 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
7488b5780f
|
[ROCm][Tests] Reduce host memory when downcasting FP32 HF references (#57869)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 22:42:47 +08:00 |
|
|
Martin Hickey
|
8b98b7d0b4
|
[Frontend] Add streaming parity tests and docs for derender (#57922)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-09-21 14:13:52 +00:00 |
|
|
Hotragn PettuganiandClaude Opus 5
|
606d124b37
|
[Bugfix][Multimodal] Tolerate malformed EXIF in Molmo 2 image preprocessing (#57234)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-21 06:27:40 -07:00 |
|
|
Chaojun ZhangandKunshang Ji
|
db7f1f6714
|
[CI][XPU] Deselect Ray UT in XPU V1 test Job (#57889)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-21 20:54:58 +08:00 |
|
|
Juan Pérez de AlgabaandCursor
|
7268f6e38e
|
[Security] Prefer fresh multimodal payloads over a stale receiver cache (#57833)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-21 12:50:48 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
82daf9f575
|
[CI][ROCm] Add ten AMD parity groups (#57876)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 11:08:06 +00:00 |
|
|
CaiJohnandjohn
|
15859bb3a1
|
[Test] Organize structured output utility tests (#57545)
Signed-off-by: john <6712432+CaiJohn@users.noreply.github.com>
Co-authored-by: john <6712432+CaiJohn@users.noreply.github.com>
|
2026-09-21 13:56:28 +03:00 |
|
|
Fangzhou AiandCursor
|
04c1f4a407
|
[Bugfix][ROCm][DSv4.1] Disable SWA bounded replay on ROCm (#57906)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-21 10:29:14 +00:00 |
|
|
|
0b7f11a1ee
|
[AuxOutput] Add block-keyed storage for routed-expert outputs (#45635)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-21 10:25:05 +00:00 |
|
|
djramic
|
0aee727ff6
|
[CI][ROCm] Increase timeout for MI300 Distributed DP Extended (#57903)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-09-21 04:18:59 -05:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
8902dbb177
|
[CI][ROCm] Mirror remaining portable suites without duplicate coverage (#57877)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 04:16:26 -05:00 |
|
|
|
b8cf275382
|
[AMD][Minimax-M3][perf] Enable packed LBHNC AITER QK-norm fusion for MiniMax-M3 on ROCm (#54535)
Signed-off-by: Wei-Ting Liao <wei-ting.liao@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-09-21 16:38:30 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
f05b88751e
|
[CI][ROCm] Make Python-only installation failures blocking (#57870)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 08:29:02 +00:00 |
|
|
|
76ffb0d374
|
[Model][Engram] Share host tables across co-located DP replicas by default (#57651)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-09-21 08:26:56 +00:00 |
|
|
akii96
|
0ff0477ff9
|
[Perf][ROCm] Add a ROCm path for Hy4 and compile the backbone (#57526)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-09-21 08:20:43 +00:00 |
|
|
Woosuk KwonandOpenAI Codex
|
67513c8b67
|
[Bugfix][DSV4.1] Restrict mHC overlap to full CUDA graphs (#57874)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 01:16:59 -07:00 |
|
|
Woosuk KwonandOpenAI Codex
|
97dc6b19d2
|
[Perf][Attention] Avoid redundant sparse attention metadata operations (#57885)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 00:08:43 -07:00 |
|
|
|
3c84ad13ed
|
[Bugfix] Fix xgrammar feature gate bypass when JSON Schema type is a list (#48416)
Signed-off-by: john <6712432+CaiJohn@users.noreply.github.com>
Co-authored-by: john <6712432+CaiJohn@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-21 09:59:20 +03:00 |
|
|
Oliver Holworthyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9598487bc1
|
[Bugfix][Model] Mistral3: align placeholder grid with public processor (#53758)
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-21 06:36:59 +00:00 |
|
|
Tianyao Wu
|
59f1527280
|
[Bugfix] Fix Whisper engine crash on audio clips longer than 30s (#57769)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
|
2026-09-21 05:44:40 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
8ec00ec2bc
|
[Tests] Release HF embedding weights after prompt extraction (#57868)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 05:27:29 +00:00 |
|
|
liuzhenweiandKunshang Ji
|
6654bcbfca
|
[MRV2][XPU] use xpu sample kernel in mrv2 sampler (#57277)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-21 13:24:41 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
76ee20c1ec
|
[ROCm][Tests] Avoid pooling cleanup waits against live shared engines (#57864)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-21 05:21:35 +00:00 |
|
|
liuzhenweiandKunshang Ji
|
a15dbbd63d
|
[XPU][CI] fallback to 7-args of moe_align_block_size (#57855)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-21 13:15:29 +08:00 |
|
|
Chaunceyandzjy0516
|
3df4ae153e
|
[Core][KDA] Generalize Mamba prefill checkpoint builder and exporter (#57783)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-09-21 04:46:11 +00:00 |
|
|
|
ff0c885494
|
[Bugfix] DiffusionGemma: fix multimodal support (#57589)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-21 00:05:24 -04:00 |
|
|
Woosuk KwonandCodex
|
9a70c233cd
|
[Perf][DSV4.1] Fuse TP all-reduce with mHC input preparation (#57643)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-20 20:28:06 -07:00 |
|
|
|
eb87980585
|
[Build] Fix DeepGEMM CUDA 12.9 release builds (#57554)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-20 20:14:00 -07:00 |
|
|
Jee Jee Li
|
86ce4d10e2
|
[BUGFIX][HY4] Record indexer completion event for full CUDA graph capture (#57811)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-09-21 10:59:11 +08:00 |
|
|
czhu-cohere
|
3918f3c5a3
|
[Profiler] Unify platform-aware torch profiling (#57460)
|
2026-09-20 19:17:23 -07:00 |
|
|
JohnQinAMD
|
6dfd87f596
|
[ROCm][DSv4.1] Keep the Engram tables in host memory on ROCm (#57491)
|
2026-09-21 10:17:11 +08:00 |
|