|
bf6c80c7e8
|
[Misc] Remove tool name from warn logs (#59294)
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-10-14 08:03:11 -07:00 |
|
|
Itay EtelisandCodex
|
efad400092
|
[HiSparse] Prefault the shared host pool in parallel (#60869)
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-14 10:28:26 -04:00 |
|
|
|
02653fa22c
|
[Bugfix][KV Offload] Fix inaccurate proportional store dropping (#59140)
Signed-off-by: Thuongvu Ho <thuongvuho@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-14 17:05:21 +03:00 |
|
|
Ashish RaoandVadim Gimpelson
|
b4b7eca0ef
|
[Bugfix][Quantization] Clamp FP8 scales before UE8M0 rounding (#58032)
Signed-off-by: Ashish Rao <asrao@nvidia.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
|
2026-10-14 13:56:42 +00:00 |
|
|
|
7115b70c01
|
[Bugfix][KV Offload][P2P] Drop a timed-out store job's blocks from the round's parked supply (#59329)
Signed-off-by: Sohom Chakraborty <16609933+sohom-cs@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-14 13:22:28 +00:00 |
|
|
Luca MotzandClaude Opus 5.5
|
2d09fdcdc2
|
[Quantization] Auto-disable DeepGEMM for Kolibri 1 on SM12x (#61274)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 12:59:50 +00:00 |
|
|
|
3723a1ea96
|
[Bugfix][Transformers backend] Fix CUDA graph capture for dynamic-rope models (#58064)
Signed-off-by: YongfengX <erkang040804@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-14 05:56:54 -07:00 |
|
|
hclandHarry Mellor
|
2631afd3fe
|
[Bugfix][Platform] Fall back to torch when device-level NVML memory is unsupported (GB10) (#57378)
Signed-off-by: hclsys <chenglunhu@gmail.com>
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-14 12:45:29 +00:00 |
|
|
Kapil AryaandOr Ozeri
|
a68dbbad05
|
[Bugfix][KV Offload] Retain offload mappings after unsafe KVCR startup failure (#57500)
Signed-off-by: Kapil Arya <kapila@nvidia.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-14 15:43:04 +03:00 |
|
|
|
775fefa804
|
[Metrics][KV Offload] Add vllm:kv_offload_config_info - generic info metrics for offloading the offloading connector (#56867)
Signed-off-by: Amir Friedman <Amir.Friedman1@ibm.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-14 12:34:37 +00:00 |
|
|
ssingh231219
|
3a5a6b11a3
|
[Perf][Model] Batch PaddleOCR-VL vision encoder and projector (#61458)
Signed-off-by: ssingh231219 <simran.singh@artificialy.com>
|
2026-10-14 19:59:44 +08:00 |
|
|
|
d39c2fb05a
|
[Bugfix][Gemma4] Quantize audio towers independently (#59935)
Signed-off-by: sudhanshu shukla <sudhanshu112233shukla@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: sudhanshu shukla <sudhanshu112233shukla@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-10-14 11:27:44 +00:00 |
|
|
Lazurite
|
23fbc2ec2f
|
[Model] Support precomputed image embeddings for LightOnOCR (#61585)
Signed-off-by: Rapisurazurite <43494437+Rapisurazurite@users.noreply.github.com>
|
2026-10-14 10:54:09 +00:00 |
|
|
xuebwang
|
81503550f3
|
[ROCm] Disable AITER FP8/FP4 BMM for MLA by default (#53123)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
|
2026-10-14 10:46:02 +00:00 |
|
|
linshi wangandOr Ozeri
|
c67c69e657
|
[Bugfix][KV Offload] Track allocated block IDs when num_external_tokens is 0 (#47046)
Signed-off-by: linshi-w <linshiw.edu@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-14 13:34:10 +03:00 |
|
|
Ronaldandaoshen02
|
19aba3e4d5
|
[Bugfix][RL] Load attention sinks through weight_loader for layerwise reload (#57797)
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-10-14 10:17:58 +00:00 |
|
|
|
f9b65c30c7
|
[ROCm][Perf] Make AITER FlyDSL GDN prefill default on gfx942/gfx950 (#60645)
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-14 10:11:57 +00:00 |
|
|
|
3f466c852c
|
[Bugfix][Parser] Recover genuine tool calls after unclosed Qwen3 <function= opener in prose (#59928)
Signed-off-by: Abhay Joshi <105213625+abhayjoshi201@users.noreply.github.com>
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: Gemini <noreply@google.com>
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-14 13:01:25 +03:00 |
|
|
Sherif Waly
|
be4ce2e505
|
[Bugfix] Share PCP-aware local GPU indexing for NUMA binding (#61237)
|
2026-10-14 10:54:03 +02:00 |
|
|
Thien TranandKimi Code
|
937d6c19df
|
[Perf][GDN] Skip FLA chunk metadata when FlashInfer GDN prefill is active (#61569)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-10-14 01:46:54 -07:00 |
|
|
Artem Perevedentsev
|
bb1438a93f
|
[CI] Fix Unlimited-OCR loading after upstream model_type rename (#61590)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-14 01:24:24 -07:00 |
|
|
|
aa0c433a3e
|
[Frontend] Accept --reasoning-parser none as the unset default (#61525)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-10-14 15:50:35 +08:00 |
|
|
|
c9bfa574ce
|
[Online quantization] Extend re-quantization API to MOE (showcase NVFP4 modelopt/CT/quark to any online MOE method) (#60276)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: Tan Pin Siang <tanpinsiang@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Tan Pin Siang <tanpinsiang@gmail.com>
|
2026-10-14 15:49:37 +08:00 |
|
|
ChaunceyandCyrus Leung
|
e1726d9142
|
[Frontend] Add cache salt and tracing to openai decisions (#61550)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-14 00:48:44 -07:00 |
|
|
zofia
|
4dc5add6ea
|
[XPU] [Linear] [MXFP8] enable torch as mxfp8 linear backend (#51933)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Signed-off-by: zofia <110436990+zufangzhu@users.noreply.github.com>
|
2026-10-14 00:48:38 -07:00 |
|
|
Jiangyun ZhuandClaude Opus 5.5
|
badfcdbf91
|
[Perf][GDN] Internal prefill checkpoints for the FlashInfer GDN prefill backend (#60050)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 14:49:46 +08:00 |
|
|
|
a2fb482732
|
[KVConnector][P2P] Register peers off the scheduler thread (#57139)
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-10-14 08:21:57 +03:00 |
|
|
|
77154ca611
|
[Perf][Model][Qwen4Exp] QSA: decode four FP8 e4m3 bytes per register below sm_89 (#60992)
Signed-off-by: kimseunghyun <hellonypcteam@gmail.com>
Co-authored-by: kimseunghyun <hellonypcteam@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-14 13:06:16 +08:00 |
|
|
Akshan Krithick
|
02d69c663a
|
[Bugfix][Benchmark] Preserve SSE output across transport chunk boundaries (#51172)
Signed-off-by: Akshan Krithick <akshankrithick305@gmail.com>
|
2026-10-13 21:58:58 -07:00 |
|
|
|
3ccc0a90b6
|
[KV Connector] Support sleep mode with MooncakeConnector over RDMA (#59625)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Dakai An <77474977+andakai@users.noreply.github.com>
|
2026-10-14 04:18:47 +00:00 |
|
|
Lanze LiuandNing Xie
|
f4b8d43a68
|
[Bugfix] Keep force-killing the process tree when a child exits mid-walk (#59984)
Signed-off-by: Lanze Liu <lanzetech@gmail.com>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
|
2026-10-13 20:33:18 -07:00 |
|
|
Shanshan Shen
|
2521446ac8
|
[ROCm][Perf] Enqueue the default chain first in CSA/HCA at small batch sizes for DeepSeek-V4 (#61378)
Signed-off-by: shen-shanshan <467638484@qq.com>
|
2026-10-14 10:57:26 +08:00 |
|
|
|
2308b6f00b
|
[Perf][MoE] Cheaper triton_kernels 3.8 routing build in the OAI Triton MoE (#58897)
Signed-off-by: Zheng Gong <zgong@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
|
2026-10-14 10:48:05 +08:00 |
|
|
xaguilar-amd
|
a1f51a0226
|
[ROCm][MLA] Route gfx942 DCP causal multi-token verify to Triton split-KV decode (#58555)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
|
2026-10-14 10:17:15 +08:00 |
|
|
Stefano CastagnettaandKartikey Vyas
|
4e0681ed56
|
[Quantization] Support packed NVFP4 Qwen4Exp PLE embeddings (#56273)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Kartikey Vyas <kartikey@artificialanalysis.ai>
|
2026-10-14 08:24:55 +08:00 |
|
|
Almog TavorandItay Alroy
|
87e7dce3a7
|
[MRV2] Keep warmup out of the EPLB load stats (#56716)
Signed-off-by: almogtavor <almogtavor@gmail.com>
Co-authored-by: Itay Alroy <75032521+itayalroy@users.noreply.github.com>
|
2026-10-14 00:00:48 +00:00 |
|
|
Ryan RockandMicah Williamson
|
f43d7e1a0f
|
[CI][AMD] Gate Aiter MHA FA on dtype (#60679)
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
|
2026-10-13 18:55:19 -05:00 |
|
|
|
c923e7769b
|
[Feat] Add text-only OpenAI Decisions API MVP (#60465)
Signed-off-by: Francisco Javier Arceo <4163062+franciscojavierarceo@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-14 07:51:08 +08:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ad8d39cbab
|
[Bugfix] Fix DSpark graph-padding handling in the DeepSeek-V4.1 MoE fused top-k (#59166)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-10-14 07:49:52 +08:00 |
|
|
Giancarlo DelfinandWoosuk Kwon
|
791f92135a
|
[Attention] Set ALWAYS cudagraph support for FA4 (#60908)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-10-13 16:22:52 -07:00 |
|
|
|
8082b62f32
|
[Mooncake] Allow Mamba cache mode none for capacity-only workers (#60712)
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 23:13:58 +00:00 |
|
|
Tim002andThien Tran
|
96fc2da315
|
[Perf][Qwen4Exp] Add SM121 TP=2 merged QSA projection plans (#61437)
Signed-off-by: TimRen01 <HolaTim@hotmail.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-10-13 22:58:44 +00:00 |
|
|
Wenbin ChenandMisha Goin
|
6463d04601
|
Fix write-after-write hazard in xpu KV RoPE triton kernel (#46685)
Signed-off-by: Wenbin Chen <wenbin.chen@intel.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-10-13 22:17:14 +00:00 |
|
|
|
698e79f3bd
|
[Model] Kolibri 1 via the Transformers modeling backend (#60827)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-13 22:17:52 +01:00 |
|
|
Anirudh Ravichandran
|
e90158d912
|
[Bugfix][MoE] Clamp BLOCK_SIZE_K to the FP8 quantization block in the batched Triton MoE (#60733)
|
2026-10-13 17:02:17 -04:00 |
|
|
Matthew BonanniandClaude Opus 5.5
|
292da21f9d
|
[HiSparse] Read GPU-resident KV directly for mixed and BF16 prefills (#60417)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 16:40:20 -04:00 |
|
|
Andreas KaratzasandClaude
|
67516b6c42
|
[Bugfix][ROCm][Kimi-K3] Stage fused KDA decode weights after loading (#61207)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-13 14:55:57 -05:00 |
|
|
|
68fc395554
|
[Bugfix] Keep GateLinear batch invariant under VLLM_BATCH_INVARIANT (#59985)
Signed-off-by: yifanFengg <evanfengff@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-10-13 15:43:54 -04:00 |
|
|
yifanFenggandClaude Fable 5.1
|
b33cb81237
|
[Bugfix] Keep compressed-tensors wNa16 linear layers batch invariant (#60524)
Signed-off-by: yifanFengg <evanfengff@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-13 15:43:40 -04:00 |
|
|
Wentao Ye
|
2f18d13cf0
|
[GLM5.3 Perf] Enable fp8 kv cache for GLM5.3 Flash by default, 9.8% E2E Throughput Improvement (#61228)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-10-13 15:29:17 -04:00 |
|