 Jane (Yuan) XuandShengqi Chen
|
f8d03e7741
|
[Bugfix][Build] Patch stable string memleak fix from 2.14 for 2.13 (#51185)
Signed-off-by: Jane Xu <janeyx@meta.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-08-08 21:12:39 -07:00 |
|
Isotr0py
|
073c510c91
|
[Migration] Migrate bitsandbytes support to OOT plugin (#43529)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-09 10:27:31 +08:00 |
|
 
|
dedbf6be8b
|
[V1][Metrics] Preserve prefix-cache stats on zero-output steps (#48668)
Signed-off-by: Rishi Puri <riship@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-09 01:58:38 +00:00 |
|
 
|
cb1a52aee3
|
[Build] Upgrade runtime image to Ubuntu 24.04, pick up rdma-core > 44 (#51058)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-08-08 18:17:50 -07:00 |
|
 Aarushi JainandAarushi Jain
|
7581c56c86
|
[Test] Add ROCm AITER FP8 MLA prefill accuracy test (#51457)
Signed-off-by: Aarushi Jain <aarushi@amd.com>
Co-authored-by: Aarushi Jain <aarushi@amd.com>
|
2026-08-08 19:42:26 -05:00 |
|
Nick Hill
|
fbff187d59
|
[Core] Make the GPU sync check thread-local and fix its suppressors (#51455)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-08 17:13:40 -07:00 |
|
Nick Hill
|
9b0afeb4f6
|
[Perf] Avoid some more unnecessary GPU<->CPU syncs (#51458)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-08 17:13:26 -07:00 |
|
 
|
d608dfabfd
|
[Bugfix][MRV2] Reserve spec-decode lookahead blocks in V2 warmup (#51438)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
|
2026-08-08 23:58:43 +00:00 |
|
 Nick HillandClaude Opus 5
|
9e6be4a72b
|
[Perf][Sparse MLA] Drop the atomic contention in the index remap (#50365)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 16:32:40 -07:00 |
|
Vegetog
|
1c1077c6cc
|
[Bugfix][Parser] Confirm reasoning end when an Inkling content block opens (#49876)
Signed-off-by: Vegetog <110553275+Vegetog@users.noreply.github.com>
|
2026-08-08 18:07:39 -04:00 |
|
 
|
75231eff2f
|
[Bugfix][Parser] Prevent Inkling block-end leakage with tools (#51391)
Signed-off-by: cherry77-cloud <1615405@qq.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-08 12:34:32 -04:00 |
|
  
|
58d3918e3e
|
[BugFix] Preserve divergent FA hits with external Mamba state (#51468)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-08 20:20:16 +08:00 |
|
 ylsunandClaude Opus 5
|
0fe9a916e8
|
[Bugfix] Fix LFM2 ShortConv prefix breaking quant ignore list (#51495)
Signed-off-by: ylsun <1654366371@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 11:27:13 +00:00 |
|
Tianyu Guo
|
653ebb52df
|
Add torch compile for qwen3_vl encoder (#40116)
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-08 08:23:18 +00:00 |
|
Andreas Karatzas
|
643c125fab
|
[ROCm][CI] Baseline legacy extensions in the Torch ABI audit (#50805)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-08 01:01:04 -05:00 |
|
Andreas Karatzas
|
6e18901195
|
[Bugfix][MM] Avoid device sync in FusedInputNorm initialization (#51435)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 13:32:23 +08:00 |
|
Jiangyun Zhu
|
44351f81d5
|
[CI] Refresh hybrid Model Runner V2 coverage (#51410)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-08-08 05:10:54 +00:00 |
|
Tianmu Li
|
700d39b558
|
[CPU] Optimize routed FP8/MXFP4 MoE GEMM dispatch (#50949)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
|
2026-08-08 12:56:14 +08:00 |
|
Junpu Yu
|
d3621c1eb3
|
[Bugfix][Multimodal] Fix PyNvVideoCodec video backend returning NCHW instead of NHWC (#51076)
Signed-off-by: Junpu Yu <davidyu@nvidia.com>
|
2026-08-08 04:49:06 +00:00 |
|
 aoshen02andOpenAI Codex
|
22a175921c
|
[BugFix] Reject invalid data-parallel RPC ports (#51469)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-08 12:23:26 +08:00 |
|
 Gyula ChinoradszkiandCursor Agent
|
d21fed9522
|
[Bugfix][models_multimodal] Remote HF python code misses importing class (#51427)
Signed-off-by: Gyula Chinoradszki <gchinora@amd.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-08-08 12:09:26 +08:00 |
|
music-dino
|
a828536fb5
|
[Bugfix][multi_modal] Fix pos_ids being unitialized for minicpmv2.6 in hf runner (#51432)
Signed-off-by: Dino Music <Dino.Music@amd.com>
|
2026-08-08 12:09:12 +08:00 |
|
Andreas Karatzas
|
12da9b23ae
|
[CI] Guard remote-code Transformers compatibility (#51451)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 12:05:49 +08:00 |
|
djramic
|
5eaa70dac5
|
[Bugfix][Quantization] Fix INT8 W8A8 MoE crash in TritonExperts (#51411)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-08-07 22:06:58 -05:00 |
|
  
|
f7ef489e93
|
[Bugfix] Fix ZMQ port TOCTOU race in shm_broadcast MessageQueue (#50960)
Signed-off-by: RTCartist <wangshengb@buaa.edu.cn>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: RTCartist <wangshengb@buaa.edu.cn>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 18:19:02 -07:00 |
|
Linkun
|
7f58e8294a
|
[Kimi][MM] disable kimi_vit's dynamic torch.compile for TPU (#51196)
Signed-off-by: Linkun Chen <github@lkchen.net>
|
2026-08-08 00:42:51 +00:00 |
|
Nils Matteson
|
1c008a346c
|
[Bugfix] Close usage telemetry HTTP sessions (#51219)
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
|
2026-08-08 00:29:36 +00:00 |
|
Woosuk Kwon
|
e644c8cd8c
|
[Perf] Optimize DeepSeek V3.2 sequence parallelism (#51434)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 16:51:01 -07:00 |
|
Wentao Ye
|
c39076feff
|
[CI Test] Add specific unit test for mrv2 offloading (#51440)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 22:49:45 +00:00 |
|
 Andrii SkliarandAleksandr Skliar
|
a801e71cb8
|
[Perf] Improve --linear-backend filtering (#48735)
Signed-off-by: Aleksandr Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Aleksandr Skliar <askliar@nvidia.com>
|
2026-08-07 15:15:54 -07:00 |
|
Woosuk Kwon
|
46b5864054
|
[Perf] Narrow DeepSeek V3.2 eager CUDA graph region (#51425)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 14:37:43 -07:00 |
|
 Michael GoinandOpenAI Codex
|
c8fe1d5715
|
[Spec Decode] Register Qwen3.6 dSpark acceptance coverage (#51310)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-07 17:07:55 -04:00 |
|
Nick Hill
|
9823714346
|
[Bugfix] Drop stale layer kwarg from online MXFP4 kernel creation (fix precommit) (#51442)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-07 13:49:00 -07:00 |
|
Jiangyun Zhu
|
27d7303802
|
[CI] Fix Batch Invariance (B200) (#51417)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-08-07 13:45:29 -07:00 |
|
Wentao Ye
|
4a11ed5bc4
|
[DSv32/GLM Perf] Skip short prefill topk for dense mha layer, 97.9% kernel level latency reduction (#51298)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 20:30:42 +00:00 |
|
Elvir Crnčević
|
99950b0b86
|
[Profiler] Stamp vLLM version/commit into torch profiler trace metadata (#51389)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
|
2026-08-07 16:29:59 -04:00 |
|
Wei-Ming Chen
|
1c94e8dc7d
|
Add NVFP4 KV 4-over-6 scale search (#45187)
Signed-off-by: weimingc <17592131+meenchen@users.noreply.github.com>
|
2026-08-07 13:22:27 -07:00 |
|
 Walter Beller-MoralesandHarry Mellor
|
70456e5e6f
|
[Bugfix] when loading weights skip empty expert bias if model does not support them (#50937)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-07 12:45:52 -07:00 |
|
Nick Hill
|
ac70ce96e0
|
[Frontend] Disable uvicorn signal handlers instead of racing them (#50916)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-07 13:40:24 -06:00 |
|
fxmarty-amd
|
3518110f2f
|
[Online quantization] Add online MXFP4 quantization support (#49347)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-08-07 12:39:46 -07:00 |
|
Wentao Ye
|
a671679e9f
|
[MRv2 Feature] MR v2 weight offloading support (#51413)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 13:20:21 -06:00 |
|
Lucas Wilkinson
|
021b7d985b
|
[Perf] Raise Blackwell CUDA graph capture default to 1024 (#49390)
|
2026-08-07 15:18:14 -04:00 |
|
![mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
56a4b63d44
|
[K3 Perf] Optimize k3 dspark fused kv, 4.5~4.6x kernel performance improvement (#50585)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-07 12:16:11 -07:00 |
|
 coltonottleyandColton Ottley
|
0df620d429
|
[Test] Add packed DeepSeek-V4 KV zeroer geometry regression (#51288)
Signed-off-by: Colton Ottley <colton@ottleyengineering.com>
Co-authored-by: Colton Ottley <colton@ottleyengineering.com>
|
2026-08-07 12:11:09 -07:00 |
|
 Aarushi JainandAarushi Jain
|
a0056e103e
|
[Test] Add ROCm AITER MLA op registration and env gating tests (#50930)
Signed-off-by: Aarushi Jain <aarushi@amd.com>
Co-authored-by: Aarushi Jain <aarushi@amd.com>
|
2026-08-07 14:07:31 -05:00 |
|
stefankoncarevic
|
ebb2972562
|
[ROCm][CI][Bugfix] Do not microbatch a step that splits a prefix from its writer (#51402)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-07 13:55:34 -05:00 |
|
wangxiyuan
|
4eccf906ca
|
[Attention] Mamba attention module refactor - Final part (#44857)
|
2026-08-07 11:27:10 -07:00 |
|
Harry Mellor
|
45273b8dcb
|
[1/N] Harden Transformers modelling backend multi-modal path (#51408)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-07 17:30:43 +00:00 |
|
 Jinzhen LinandOpenAI Codex
|
fcde8e1460
|
[Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-07 10:03:19 -07:00 |
|
vanshbhatia-amd
|
e229fdbc87
|
[ROCm] Add tuned selective_state_update float32 config for AMD Instinct MI325X (#50007)
Signed-off-by: vanshbhatia-amd <vansh.bhatia@amd.com>
|
2026-08-07 12:58:36 -04:00 |
|