 Nick HillandClaude Opus 5
|
9e6be4a72b
|
[Perf][Sparse MLA] Drop the atomic contention in the index remap (#50365)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 16:32:40 -07:00 |
|
|
Vegetog
|
1c1077c6cc
|
[Bugfix][Parser] Confirm reasoning end when an Inkling content block opens (#49876)
Signed-off-by: Vegetog <110553275+Vegetog@users.noreply.github.com>
|
2026-08-08 18:07:39 -04:00 |
|
|
|
75231eff2f
|
[Bugfix][Parser] Prevent Inkling block-end leakage with tools (#51391)
Signed-off-by: cherry77-cloud <1615405@qq.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-08 12:34:32 -04:00 |
|
|
|
58d3918e3e
|
[BugFix] Preserve divergent FA hits with external Mamba state (#51468)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-08 20:20:16 +08:00 |
|
|
ylsunandClaude Opus 5
|
0fe9a916e8
|
[Bugfix] Fix LFM2 ShortConv prefix breaking quant ignore list (#51495)
Signed-off-by: ylsun <1654366371@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 11:27:13 +00:00 |
|
|
Tianyu Guo
|
653ebb52df
|
Add torch compile for qwen3_vl encoder (#40116)
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-08 08:23:18 +00:00 |
|
|
Andreas Karatzas
|
643c125fab
|
[ROCm][CI] Baseline legacy extensions in the Torch ABI audit (#50805)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-08 01:01:04 -05:00 |
|
|
Andreas Karatzas
|
6e18901195
|
[Bugfix][MM] Avoid device sync in FusedInputNorm initialization (#51435)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 13:32:23 +08:00 |
|
|
Jiangyun Zhu
|
44351f81d5
|
[CI] Refresh hybrid Model Runner V2 coverage (#51410)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-08-08 05:10:54 +00:00 |
|
|
Tianmu Li
|
700d39b558
|
[CPU] Optimize routed FP8/MXFP4 MoE GEMM dispatch (#50949)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
|
2026-08-08 12:56:14 +08:00 |
|
|
Junpu Yu
|
d3621c1eb3
|
[Bugfix][Multimodal] Fix PyNvVideoCodec video backend returning NCHW instead of NHWC (#51076)
Signed-off-by: Junpu Yu <davidyu@nvidia.com>
|
2026-08-08 04:49:06 +00:00 |
|
|
aoshen02andOpenAI Codex
|
22a175921c
|
[BugFix] Reject invalid data-parallel RPC ports (#51469)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-08 12:23:26 +08:00 |
|
|
Gyula ChinoradszkiandCursor Agent
|
d21fed9522
|
[Bugfix][models_multimodal] Remote HF python code misses importing class (#51427)
Signed-off-by: Gyula Chinoradszki <gchinora@amd.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-08-08 12:09:26 +08:00 |
|
|
music-dino
|
a828536fb5
|
[Bugfix][multi_modal] Fix pos_ids being unitialized for minicpmv2.6 in hf runner (#51432)
Signed-off-by: Dino Music <Dino.Music@amd.com>
|
2026-08-08 12:09:12 +08:00 |
|
|
Andreas Karatzas
|
12da9b23ae
|
[CI] Guard remote-code Transformers compatibility (#51451)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 12:05:49 +08:00 |
|
|
djramic
|
5eaa70dac5
|
[Bugfix][Quantization] Fix INT8 W8A8 MoE crash in TritonExperts (#51411)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-08-07 22:06:58 -05:00 |
|
|
|
f7ef489e93
|
[Bugfix] Fix ZMQ port TOCTOU race in shm_broadcast MessageQueue (#50960)
Signed-off-by: RTCartist <wangshengb@buaa.edu.cn>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: RTCartist <wangshengb@buaa.edu.cn>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 18:19:02 -07:00 |
|
|
Linkun
|
7f58e8294a
|
[Kimi][MM] disable kimi_vit's dynamic torch.compile for TPU (#51196)
Signed-off-by: Linkun Chen <github@lkchen.net>
|
2026-08-08 00:42:51 +00:00 |
|
|
Nils Matteson
|
1c008a346c
|
[Bugfix] Close usage telemetry HTTP sessions (#51219)
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
|
2026-08-08 00:29:36 +00:00 |
|
|
Woosuk Kwon
|
e644c8cd8c
|
[Perf] Optimize DeepSeek V3.2 sequence parallelism (#51434)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 16:51:01 -07:00 |
|
|
Wentao Ye
|
c39076feff
|
[CI Test] Add specific unit test for mrv2 offloading (#51440)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 22:49:45 +00:00 |
|
|
Andrii SkliarandAleksandr Skliar
|
a801e71cb8
|
[Perf] Improve --linear-backend filtering (#48735)
Signed-off-by: Aleksandr Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Aleksandr Skliar <askliar@nvidia.com>
|
2026-08-07 15:15:54 -07:00 |
|
|
Woosuk Kwon
|
46b5864054
|
[Perf] Narrow DeepSeek V3.2 eager CUDA graph region (#51425)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 14:37:43 -07:00 |
|
|
Michael GoinandOpenAI Codex
|
c8fe1d5715
|
[Spec Decode] Register Qwen3.6 dSpark acceptance coverage (#51310)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-07 17:07:55 -04:00 |
|
|
Nick Hill
|
9823714346
|
[Bugfix] Drop stale layer kwarg from online MXFP4 kernel creation (fix precommit) (#51442)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-07 13:49:00 -07:00 |
|
|
Jiangyun Zhu
|
27d7303802
|
[CI] Fix Batch Invariance (B200) (#51417)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-08-07 13:45:29 -07:00 |
|
|
Wentao Ye
|
4a11ed5bc4
|
[DSv32/GLM Perf] Skip short prefill topk for dense mha layer, 97.9% kernel level latency reduction (#51298)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 20:30:42 +00:00 |
|
|
Elvir Crnčević
|
99950b0b86
|
[Profiler] Stamp vLLM version/commit into torch profiler trace metadata (#51389)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
|
2026-08-07 16:29:59 -04:00 |
|
|
Wei-Ming Chen
|
1c94e8dc7d
|
Add NVFP4 KV 4-over-6 scale search (#45187)
Signed-off-by: weimingc <17592131+meenchen@users.noreply.github.com>
|
2026-08-07 13:22:27 -07:00 |
|
|
Walter Beller-MoralesandHarry Mellor
|
70456e5e6f
|
[Bugfix] when loading weights skip empty expert bias if model does not support them (#50937)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-07 12:45:52 -07:00 |
|
|
Nick Hill
|
ac70ce96e0
|
[Frontend] Disable uvicorn signal handlers instead of racing them (#50916)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-07 13:40:24 -06:00 |
|
|
fxmarty-amd
|
3518110f2f
|
[Online quantization] Add online MXFP4 quantization support (#49347)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-08-07 12:39:46 -07:00 |
|
|
Wentao Ye
|
a671679e9f
|
[MRv2 Feature] MR v2 weight offloading support (#51413)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-07 13:20:21 -06:00 |
|
|
Lucas Wilkinson
|
021b7d985b
|
[Perf] Raise Blackwell CUDA graph capture default to 1024 (#49390)
|
2026-08-07 15:18:14 -04:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
56a4b63d44
|
[K3 Perf] Optimize k3 dspark fused kv, 4.5~4.6x kernel performance improvement (#50585)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-07 12:16:11 -07:00 |
|
|
coltonottleyandColton Ottley
|
0df620d429
|
[Test] Add packed DeepSeek-V4 KV zeroer geometry regression (#51288)
Signed-off-by: Colton Ottley <colton@ottleyengineering.com>
Co-authored-by: Colton Ottley <colton@ottleyengineering.com>
|
2026-08-07 12:11:09 -07:00 |
|
|
Aarushi JainandAarushi Jain
|
a0056e103e
|
[Test] Add ROCm AITER MLA op registration and env gating tests (#50930)
Signed-off-by: Aarushi Jain <aarushi@amd.com>
Co-authored-by: Aarushi Jain <aarushi@amd.com>
|
2026-08-07 14:07:31 -05:00 |
|
|
stefankoncarevic
|
ebb2972562
|
[ROCm][CI][Bugfix] Do not microbatch a step that splits a prefix from its writer (#51402)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-07 13:55:34 -05:00 |
|
|
wangxiyuan
|
4eccf906ca
|
[Attention] Mamba attention module refactor - Final part (#44857)
|
2026-08-07 11:27:10 -07:00 |
|
|
Harry Mellor
|
45273b8dcb
|
[1/N] Harden Transformers modelling backend multi-modal path (#51408)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-07 17:30:43 +00:00 |
|
|
Jinzhen LinandOpenAI Codex
|
fcde8e1460
|
[Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-07 10:03:19 -07:00 |
|
|
vanshbhatia-amd
|
e229fdbc87
|
[ROCm] Add tuned selective_state_update float32 config for AMD Instinct MI325X (#50007)
Signed-off-by: vanshbhatia-amd <vansh.bhatia@amd.com>
|
2026-08-07 12:58:36 -04:00 |
|
|
Jack HuandAndreas Karatzas
|
34c1cd20a5
|
[Bugfix][ROCm] Fix ROCM_AITER_FA & ROCM_AITER_UNIFIED_ATTN QK-Norm+RoPE+KVCache fusion for the packed KV-cache [BLOCKS, HEADS, BLOCK_SIZE, 2*HEAD_DIM] layout (#49373)
Signed-off-by: Jack Hu <Jack.Hu@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-07 09:54:55 -07:00 |
|
|
Flora Cui
|
7e85d3a42c
|
[ROCm] Enable pinned memory on supported WSL2 kernels (#50126)
Signed-off-by: Flora Cui <flora.cui@amd.com>
|
2026-08-07 10:43:42 -05:00 |
|
|
|
448344c0e2
|
[Bugfix] Fix get_open_port() livelock on DP-reserved ports and cover get_open_ports_list (#50965)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: ferkans-amir <amir.rezaei@tu-berlin.de>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 22:39:33 +08:00 |
|
|
|
47228db84c
|
[Bugfix][KV-transfer] MoRIIO: per-layer READ-completion barrier in wait_for_layer_load (#48534)
Signed-off-by: Edwin Lim <edwin.lim@mangoboost.io>
Signed-off-by: Redwan Khan <redwan.khan@mangoboost.io>
Signed-off-by: harishk-mangoboost <harish.kambhampaty@mangoboost.io>
Signed-off-by: limeward <32970461+edwinlim0919@users.noreply.github.com>
Signed-off-by: QinPR <1905873179@qq.com>
Co-authored-by: Jaeyoun Kim <jaeyoun.kim@mangoboost.io>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Redwan Khan <redwan.khan@mangoboost.io>
Co-authored-by: harishk-mangoboost <harish.kambhampaty@mangoboost.io>
Co-authored-by: rkhan055 <redwankhan055@gmail.com>
Co-authored-by: Peiran Qin <66068739+QinPR@users.noreply.github.com>
Co-authored-by: QinPR <1905873179@qq.com>
|
2026-08-07 14:23:33 +00:00 |
|
|
Nicolò Lucchesi
|
d4ecb75ba2
|
[PD][NixlPush][Bugfix] Fix prefix caching (#48758)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-07 16:21:17 +02:00 |
|
|
haic0
|
f2bfad9167
|
[Model] Enable Qwen3.8 for AMD Rocm (#50068)
Signed-off-by: haic0 <haic0@users.noreply.github.com>
Signed-off-by: haic0 <haichzha@amd.com>
|
2026-08-07 21:19:07 +08:00 |
|
|
music-dinoandHarry Mellor
|
a231c5ceac
|
[Bugfix] Skip fetching revision for model when model and weights_model are different (#51260)
Signed-off-by: Dino Music <Dino.Music@amd.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-07 12:55:50 +00:00 |
|
|
Xiaochang WuandKunshang Ji
|
d5aae2b464
|
Fix ROCm architecture import on non-ROCm platforms (#51357)
Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
Signed-off-by: Xiaochang Wu <xiaochang.wu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-07 05:32:56 -07:00 |
|