 Paarth SharmaandWentao Ye
|
a18dbe49ad
|
[Doc] Add EXAONE-4.0-1.2B to batch invariance tested models (#53839)
Signed-off-by: Cogniera <paarths376@gmail.com>
Signed-off-by: Paarth Sharma <paarths376@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-27 18:38:03 +00:00 |
|
Elvir Crnčević
|
674c284dbd
|
Fix Humming MoE activation_output aliasing (#54056)
|
2026-08-27 18:28:38 +00:00 |
|
Taneem Ibrahim
|
d7b6a35967
|
[Bugfix] Handle malformed namespace tools (#53763)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-27 14:18:16 -04:00 |
|
Summer Yang
|
07242faa46
|
[Attention][DCP] Use FlashInfer native CP for MLA decode (#54012)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-27 10:32:45 -07:00 |
|
Shanshan Shen
|
32ad1400d7
|
[ROCm][Perf] Fuse SWA q/kv RMSNorm and q FP8 group quant for DeepSeek-V4 (#53540)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
|
2026-08-27 09:37:54 -07:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) Shang Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9650dc73e2
|
[CI/Build][Hardware][NVIDIA] Add opt-in Rubin Docker builds (#53443)
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-27 16:06:44 +00:00 |
|
Chauncey
|
d21c5b50a1
|
[Perf][GLM5.2] Fuse sparse MLA Q concatenation with head padding (#53878)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-27 11:54:32 -04:00 |
|
Nick Hill
|
76c0c6530e
|
[Bugfix][Scheduler] Don't pad spec decode up to max_model_len (#53962)
|
2026-08-27 08:30:22 -07:00 |
|
Taneem Ibrahim
|
f18e29834b
|
[Bugfix] Preserve parallel HY-V3 calls delivered in one streaming delta (#53965)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-27 11:26:10 -04:00 |
|
Matthew Bonanni
|
d85708f7a4
|
[1/N][KV Connector] Identify externally transferable KV cache groups (#53779)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-08-27 11:21:24 -04:00 |
|
Khushali Desai
|
c7b0467c25
|
buffer size insuffient Dspark sd for FlashInfer MNNVL allreduce (#50932)
|
2026-08-27 11:01:08 -04:00 |
|
Itay Alroy
|
6d11122607
|
[Elastic EP] Preserve AOT cache reuse during scaling (#53378)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
|
2026-08-27 14:55:44 +00:00 |
|
 Matthew BonanniandOpenAI Codex
|
75dea9b4ae
|
[Bugfix] Update FlashMLA for sparse decode workspace fix (#53755)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 13:37:29 +00:00 |
|
Hert4
|
4a6a3272e8
|
[Bugfix][Frontend] Let pooling requests set padding (#51157)
Signed-off-by: Hert4 <ductransa01@gmail.com>
|
2026-08-27 11:06:20 +00:00 |
|
hcl
|
42e7942ac9
|
fix(config): guard LlamaBidirectionalConfig against missing hf_config.pooling (#50536)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
|
2026-08-27 18:56:07 +08:00 |
|
 Jiangyun ZhuandOpenAI Codex
|
478ec3ea41
|
[Bugfix][KV Offload] Handle padded GPU cache storage (#54021)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-27 10:52:59 +00:00 |
|
 
|
6c4aa8bec3
|
[RL] Support checkpoint-coordinate sparse NCCL weight updates (#53751)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-27 18:19:51 +08:00 |
|
Ting SUN
|
50708f95ae
|
[Bugfix][OpenAI] Fix streamed completion logprob offsets with echo (#47815)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-08-27 18:19:07 +08:00 |
|
Hung Hoang (黄兴)
|
acd0af90e8
|
[Bugfix] Raise clear error on interleaved multimodal placeholder overcount (#53999)
Signed-off-by: hungh <hungh@nvidia.com>
|
2026-08-27 09:49:40 +00:00 |
|
Charlie Fu
|
fd57c4b7af
|
[Rocm][CI] add dockerfile.xpu to rocm ci artifact (#53949)
Signed-off-by: charlifu <charlifu@amd.com>
|
2026-08-27 01:06:48 -07:00 |
|
Louie Tsai
|
79651d6085
|
[Tools][Recipes] Improve sweep recommendations and short-alias parsing (#53946)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-08-27 06:58:23 +00:00 |
|
Canlin Guo
|
aa640684cc
|
[Kimi K3][Kernel] Support DS conv-state layout in fused KDA decode kernel (#53396)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-26 23:54:50 -07:00 |
|
 Zupeng WangandOpenAI
|
833fa6233c
|
[Benchmark] Warn on warm prefix cache for random serve runs (#53920)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
|
2026-08-27 05:51:17 +00:00 |
|
Qiu Chunshuo
|
b3af042abd
|
Bugfix: use PCP slot mappings for PIECEWISE capture (#53869)
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
|
2026-08-27 05:39:36 +00:00 |
|
liuzhenwei
|
f25c580af1
|
[XPU][Dockerfile] Update UCX install (#53817)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-27 04:34:03 +00:00 |
|
Giancarlo Delfin
|
5acc1c4e4b
|
[Model Runner V2][Spec Decode] Skip DP sync before EAGLE/MTP draft prefill (#53694)
|
2026-08-26 20:59:35 -07:00 |
|
Ning Xie
|
ca90b9e7d4
|
[warmup] overlap renderer warmup and engine core initialization (#52764)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-27 11:42:08 +08:00 |
|
 omerpaz95andClaude Opus 5
|
f8d38fbc87
|
[EC Connector] EC Offloading Connector use events instead of StepTracker (#49994)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 03:41:46 +00:00 |
|
Wei Zhao
|
94d96e2446
|
[Bugfix] Release CUDA graph profiling memory before KV cache allocation (#53955)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-27 01:35:59 +00:00 |
|
rasmith
|
2dc53bae17
|
[AMD][BugFix] Add gpu_sync_allowed to ROCm AITER FA backend (#53641)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
|
2026-08-26 18:23:04 -07:00 |
|
 yzong-rhandBen Browning
|
51d1b45182
|
[Bugfix][GPT-OSS] Fix strict tool-call grammar to accept Harmony renders (#52222)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-08-26 18:05:09 -07:00 |
|
 vllm-agentandKevin Luu
|
d1e5e66ee3
|
[Bugfix] Restore portable all2all backend default (#53952)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-26 16:19:49 -07:00 |
|
 
|
3fd72ffd7b
|
[Bugfix][Rust Frontend] Fix LogprobsTensors wire schema mismatch (#53939)
Signed-off-by: jungjiyu <libraryofjiyu@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-26 16:16:43 -07:00 |
|
liuzhenwei
|
a27e88c862
|
[XPU][CI] increase timeout of extract_hidden_states tp2 (#53862)
|
2026-08-26 15:57:36 -07:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) 
|
f18d0ba90d
|
[Doc] Add Granite 3.1 series to batch invariance tested models (#53650)
Signed-off-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 18:29:10 -04:00 |
|
Wentao Ye
|
76cfe1cd88
|
[Kimi K3 Perf] Optimize eh_proj linear calculation, 12.9 ~ 25.2% kernel performance improvement (#53942)
|
2026-08-26 17:08:02 -04:00 |
|
 Venkat Balaji SandBen Browning
|
161ffd37d2
|
[Bugfix] Guard tool call argument JSON parsing in chat message postprocessing (#48922)
Signed-off-by: VBS2004 <venkatbalaji2004@gmail.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-08-26 20:26:00 +00:00 |
|
xiangdong
|
00ca27d0c1
|
[XPU][TEST]Move LoRA Multimodal to B70 in Intel GPU CI (#53841)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-08-26 20:04:10 +00:00 |
|
Woosuk Kwon
|
0a5ad6f0d4
|
[Model] Remove unused DeepSeek V4 top-k buffer helper (#53697)
|
2026-08-26 11:59:09 -07:00 |
|
 xiaohuguo2023andCursor
|
1a085dadf2
|
[ROCm][K3] Extend FP8 asm MLA prefill to non-divisor small head counts (#51040)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-26 17:47:16 +00:00 |
|
aoshen02
|
17da48596c
|
[Bugfix][DP] Synchronize the device on pause completion (#52914)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-26 09:50:33 -07:00 |
|
 Avinash Paulandavininjamay8
|
8d301f075b
|
[Bugfix][ROCm][Disagg] Fix MoRIIO shared KV memory region registration (#53698)
Signed-off-by: avininjamay8 <avpaul@amd.com>
Co-authored-by: avininjamay8 <avpaul@amd.com>
|
2026-08-27 00:10:57 +08:00 |
|
 Konstantin DunasandOpenAI Codex
|
c71f6f8a81
|
[Bugfix] Thread kv_transfer_params into engine for /inference/v1/generate (disagg) (#42644)
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-26 08:42:52 -07:00 |
|
 Luciano MartinsandLuciano Martins
|
2ab187430b
|
[Bugfix] Make Gemma4 MTP suppress_tokens masking CUDA-graph-safe (#53884)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-08-26 15:39:19 +00:00 |
|
Fangzhou Ai
|
657f9b9ce2
|
[ROCm][DSV4][Perf] Fuse DeepSeek V4 C4 compressor GEMMs (#53838)
Signed-off-by: fai <fangzhouai@gmail.com>
|
2026-08-26 23:36:14 +08:00 |
|
fanxingran
|
080a66a69c
|
[Bugfix][ROCm] Capture CUDA graphs on the current stream (#53818)
Signed-off-by: fanxingran <xingran.fan@amd.com>
|
2026-08-26 23:16:45 +08:00 |
|
 Oliver HolworthyandOpenAI Codex
|
28b484e5d7
|
[Model] Pixtral: use packed multimodal encoder attention (#52185)
Signed-off-by: Oliver Holworthy <1216955+oliverholworthy@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-26 14:14:40 +00:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) 
|
c47ca4aaeb
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[tT]" (#53466)
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-26 14:12:11 +00:00 |
|
Tony
|
903a02192f
|
[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)
Signed-off-by: tony <864832769@qq.com>
|
2026-08-26 21:00:54 +08:00 |
|
 Robert ShawandRobert Shaw
|
6a5e8f5979
|
[DeepEPv2] Support MXFp8 Activation Scale Dispatch (#51398)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
|
2026-08-26 12:26:11 +00:00 |
|