 Qiming Zhang
|
754e1c3de4
|
[CI][XPU] Skip test_fused_shared_expert.py on XPU (#53035)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-20 14:56:09 +08:00 |
|
|
|
9b2aef5124
|
[Bugfix] Video loading: sample over presentable frames, not header sample count (MP4 edit-list trims) (#48608)
Signed-off-by: AmitMY <amitmoryossef@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-20 04:23:09 +00:00 |
|
|
Andreas Karatzas
|
4f66bc3e0d
|
[CI][ROCm] Standardize AMD test job labels by device (#52976)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-19 22:33:25 -05:00 |
|
|
Yufeng HeandChauncey
|
e85dd21497
|
fix: report stop_sequence stop_reason in Anthropic Messages API (#45807)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-08-20 03:23:43 +00:00 |
|
|
|
76fb6d210a
|
[Bugfix][Core] Reserve the KV null block when validating max_model_len (#47272)
Signed-off-by: hyungjun oh <92hyungjun@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-20 02:49:23 +00:00 |
|
|
|
fbb4c04db4
|
[ROCm][CI] Speed up test_rocm_aiter_qk_norm_rope_kvcache_fusion (#53004)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-19 21:20:21 -05:00 |
|
|
Summer YangandWoosuk Kwon
|
58e5ee0158
|
[refactor] consolidate cp attn ops (#52839)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-19 18:04:11 -07:00 |
|
|
Guanyi Chenandz-zanez
|
bf2866f8bf
|
[KV Connector] Add decode offloading to Mooncake Store consumers (#52466)
Signed-off-by: z-zanez <zhouzh93@mail2.sysu.edu.cn>
Signed-off-by: Guanyi Chen <939416532@qq.com>
Co-authored-by: z-zanez <zhouzh93@mail2.sysu.edu.cn>
|
2026-08-19 17:40:35 -07:00 |
|
|
Giancarlo Delfin
|
d4f4d3f40f
|
[Model Runner V2][Spec Decode] Fix draft logits cache column stride in gumbel_sample (#53017)
|
2026-08-19 17:39:30 -07:00 |
|
|
Sage Moore
|
5bf0dbd6fd
|
[Bugfix] vLLM crashes at startup when DeepEP v2 is used with --enforce-eager wiht TRTLLM Bf16 (#51824)
|
2026-08-19 20:18:47 -04:00 |
|
|
Misha GoinandOpenAI Codex
|
541c6d64c1
|
[Bugfix][Quantization] Support CT block FP8 with Marlin (#52966)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-19 12:41:26 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
cb58bb9c1e
|
[CI] Harden RemoteVLLMServer GPU cleanup checks (#52282)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-19 14:17:17 -05:00 |
|
|
Andreas Karatzas
|
480d4f0d15
|
[ROCm][CI] Enable modular OAI Triton MoE tests (#46434)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-19 13:46:12 -05:00 |
|
|
linitra24andJee Jee Li
|
9b5f3454f2
|
[LoRA] Avoid false target matches for unsupported module types (#52313)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-19 16:48:11 +00:00 |
|
|
lxyand“新颐”
|
0c8c3f41cf
|
[Bugfix][V1] Sync mamba_block_size via EngineCoreReadyResponse (#50809)
Signed-off-by: “新颐” <lxy537258@antgroup.com>
Co-authored-by: “新颐” <lxy537258@antgroup.com>
|
2026-08-19 16:44:36 +00:00 |
|
|
|
3a386cfaf5
|
[ROCm] Give EngineCore cleanup grace after request abort (#52281)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-19 11:39:59 -05:00 |
|
|
EgorandClaude
|
e9e1630e93
|
[Model] Support bidirectional (encoder-only) attention for DeepSeek e… (#52948)
Signed-off-by: Egor <erop001@gmail.com>
Signed-off-by: Egor <47443236+Lossfull@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-19 16:36:27 +00:00 |
|
|
|
54dd98be28
|
[CT] Support Humming for WNA16 MoE (#48918)
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-19 12:31:32 -04:00 |
|
|
xuebwang-amd
|
c676232313
|
[Bugfix][Quantization] Fix OCP MX MoE emulation silently skipping mxfp6 activation QDQ (#52704)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
|
2026-08-19 11:29:29 -05:00 |
|
|
akii96
|
583a00257d
|
[ROCm] [Bugfix] Fix Triton fused shared expert alignment (#51632)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-08-20 00:14:52 +08:00 |
|
|
Dinesh Chitlangia
|
525b7bbb3a
|
[Bugfix][CPU] Enable C++ causal_conv1d GDN path and float32 SSM cache on non-AMX AVX-512BF16 CPUs (#49688)
Signed-off-by: Dinesh Chitlangia <dineshchitlangia@gmail.com>
|
2026-08-19 10:50:59 -05:00 |
|
|
Andreas Karatzas
|
17dbd42930
|
[ROCm] Add UE8M0 scale packing for Triton silu_mul_quant (#37835)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-19 10:20:05 -05:00 |
|
|
Andreas Karatzas
|
160f7f0840
|
[ROCm][CI] Extended Fused MoE and FP8 MoE test support (#41100)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-19 10:19:42 -05:00 |
|
|
Xiaoan (Sean) LiuandNick Hill
|
db92053e97
|
[Core] Skip broadcasting mm tensor data to workers for prefix-cache-covered items (#52041)
Signed-off-by: Xiaoan (Sean) Liu <shawnliu0327@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-19 07:16:39 -07:00 |
|
|
Quentin Gallouédec
|
92bdee05cb
|
[Bugfix][Frontend] Return all choices from /inference/v1/generate when n > 1 (#52399)
Signed-off-by: Quentin Gallouédec <quentin.gallouedec@huggingface.co>
|
2026-08-19 20:48:45 +08:00 |
|
|
Nave Assaf
|
58de6cbdc2
|
Add NemotronH_Omni_Reasoning_V3 as a supported Nemotron architecture (#52929)
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
|
2026-08-19 12:34:50 +00:00 |
|
|
hy123andOpenAI Codex
|
b160cab156
|
[Bugfix] Restore model info caching for package backends (#52690)
Signed-off-by: haoyang.qian <haoyangqian@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-19 11:18:10 +00:00 |
|
|
wang.yuqi
|
eac636a7fa
|
[Frontend] Move api_server.py out openai folder (#52131)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-19 09:43:46 +00:00 |
|
|
Yufeng He
|
340b7e4909
|
fix: reject string schemas that mix pattern/format with length bounds (#49996)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
|
2026-08-19 17:29:32 +08:00 |
|
|
LuckyStep
|
9a9aa2b017
|
[Bugfix] Redact api_key in non-default args log (#52523)
Signed-off-by: LuckyStep <67696304+Andy365-365@users.noreply.github.com>
|
2026-08-19 15:52:53 +08:00 |
|
|
Woosuk Kwon
|
b09bd69b5b
|
[Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861)
|
2026-08-19 00:13:52 -07:00 |
|
|
Vineeth Sai Varikuntla
|
86a89a9348
|
[Bugfix][Frontend] Run the serve arg checks for vllm launch too (#52825)
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com>
|
2026-08-19 04:48:50 +00:00 |
|
|
Taneem Ibrahim
|
08afae2786
|
[ModelRunner v2] Enable MRV2 for pooling models by default (#48290)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-18 21:36:05 -07:00 |
|
|
|
63ff748f65
|
[Attention][MLA] FlashMLA sparse: DCP on the fp8_ds_mla mixed-batch path + MTP (#46514)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-19 00:02:09 -04:00 |
|
|
|
3130573630
|
[Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-18 20:32:46 -07:00 |
|
|
Matthew Bonanniandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
8e46accab2
|
[Attention] Vectorize sparse MLA mask loads (#52217)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 20:32:41 -07:00 |
|
|
Qiming Zhang
|
e575b5f1a9
|
[XPU][CI] fix hf runner (#52730)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-19 11:30:47 +08:00 |
|
|
Willow Lopez
|
f936a267f9
|
[Bugfix][XPU] Fix Mamba state pointer overflow (#48109)
Signed-off-by: Oxygen56 <jiangth99@163.com>
|
2026-08-19 10:45:41 +08:00 |
|
|
Li, Jiang
|
e4d61d0d22
|
[CPU] Add AMX-only high-performance MLA backend for DeepSeek V2/V3/R1 (#52616)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-19 10:28:52 +08:00 |
|
|
Chaojun Zhang
|
f485081e8b
|
[XPU] Support EC connector KV Offloading on XPU (#49532)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-08-19 10:25:23 +08:00 |
|
|
liuzhenwei
|
b1d9337e92
|
[EPD] Allow KV consumers to omit MM embeddings (#52697)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-19 02:16:08 +00:00 |
|
|
Itay Alroy
|
a2257f95b7
|
[Elastic EP] Reduce eager-mode reconfiguration downtime (#51885)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
|
2026-08-19 02:13:06 +00:00 |
|
|
|
b05ae5dc00
|
[CI][Bugfix] Complete DeepSeek-V4 FSE test fixture contract (#52842)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-18 19:04:10 -06:00 |
|
|
Woosuk KwonandOpenAI Codex
|
f1178f3a06
|
Revert DSv4 eager workspace reuse (#52836)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-18 17:02:59 -07:00 |
|
|
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
|
a9f4afb66f
|
[Bugfix] Fix DeepSeek V4 mHC broadcast buffer for dummy load (#51368)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
|
2026-08-18 17:02:18 -07:00 |
|
|
Russell BryantandClaude Opus 4.8
|
ef47a897e2
|
[Core] Make prefix-cache NONE_HASH deterministic by default (#51875)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-18 23:14:39 +00:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
aa6abec49a
|
[CI][ROCm] Prevent Git maintenance races during shallow fetches (#52810)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-18 15:34:50 -07:00 |
|
|
Summer Yang
|
5f7a20b316
|
[nv] add pcp support in dsv3.2 (#52046)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-18 14:59:08 -07:00 |
|
|
stefankoncarevic
|
6066bb3d50
|
[ROCM][CI] Attention test speedup (#52763)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-08-18 16:40:30 -05:00 |
|
|
yinfengLiuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
5d8a4cf976
|
[ROCm] Pad non-aligned AITER MLA heads (#51647)
Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 16:37:10 -05:00 |
|