 Tarun Kumar
|
48bada6ea4
|
Fix chat completion 500 on non-object JSON bodies (#51654)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
|
2026-08-11 01:31:19 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f1e921b6d6
|
[Rust Frontend] Support dynamic tools from developer messages (#51144)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-10 18:30:38 -07:00 |
|
|
Qiuyang Yue
|
b2506d62ae
|
[MM][CG][BugFix] Fix Ernie-4.5-VL encoder CG postprocess for multi-path outputs (#51461)
Signed-off-by: qyYue1389 <yueqiuyang1389@gmail.com>
|
2026-08-11 00:39:04 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
d8c70f2243
|
[Rust Frontend] Upgrade MiniJinja to 2.22 & remove method lookup workaround (#51235)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 00:23:24 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
8a9f9f762a
|
[CI] Parallelize release image publishing (#51735)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-10 16:38:22 -07:00 |
|
|
Myeongwon Kim
|
8977ea8895
|
[Perf] Skip detokenization in offline beam search (#50333)
Signed-off-by: samuelkim7 <samuelmwkim@gmail.com>
|
2026-08-10 16:17:38 -07:00 |
|
|
Flora FengandWentao Ye
|
8bcc916a98
|
[Bugfix] Fix DeepSeek V4/3.2 tokenizer vocab size overcount crashing guided decoding (#51727)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-10 23:00:08 +00:00 |
|
|
Giancarlo DelfinandWoosuk Kwon
|
3e174bb73c
|
[Model Runner V2][MTP] Share topk index buffer between draft steps (#47352)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-10 15:46:13 -07:00 |
|
|
Almog Tavor
|
c3cac8c63d
|
[Bugfix][MiMo] Apply vision attention sinks in the window attention path (#49815)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-10 22:36:42 +00:00 |
|
|
Tristan Rice
|
98a4144a41
|
[Bugfix] Preserve non-logitproc entry points in tests (#51097)
Signed-off-by: Tristan Rice <rice@fn.lc>
|
2026-08-10 18:14:53 -04:00 |
|
|
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
fa722b9f01
|
[Rust Frontend][gRPC] Add explicit data-parallel rank routing (#51178)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-10 15:05:24 -07:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
3c6b2e9c08
|
[CI] Add /ci cancel command (#51732)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-10 14:55:26 -07:00 |
|
|
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
635dd6aae6
|
[Build][gRPC] Publish protobuf schemas to Buf (#51276)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-10 13:34:39 -07:00 |
|
|
|
63ac04a61e
|
[Kimi-K3] DCP support (#50484)
Signed-off-by: girasoley <girasoley@inferact.ai>
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Signed-off-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Co-authored-by: foraxe <73625538+foraxe@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-10 12:54:26 -07:00 |
|
|
Flora Feng
|
3f142bd85e
|
[Bugfix] Align deepseek v4 parser thinking default with tokenizer (#51296)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-08-10 19:30:30 +00:00 |
|
|
|
d40c3e3c00
|
Fix DSpark warmup without sparse index buffer (#50693)
Signed-off-by: xijiade.aihemaiti <3146335281@qq.com>
Signed-off-by: xijiaat <52128022+xijiaat@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-10 15:12:19 -04:00 |
|
|
|
1482d2e015
|
[ROCm][DistInf] Enable vLLM DI CI with buildkite/slurm (#47030)
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
Co-authored-by: Sheral Kumar <shekumar@amd.com>
Co-authored-by: avininjamay8 <Avinash.Paul@amd.com>
Co-authored-by: tej <37236721+itej89@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-10 18:39:26 +00:00 |
|
|
Flora Feng
|
05f0a80016
|
[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#49227)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-08-10 14:29:20 -04:00 |
|
|
|
405bc86768
|
[Perf] Launch the top-k/top-p Triton sampler kernel with 8 warps (#51507)
Signed-off-by: BabyDrangoner <148877251+BabyDrangoner@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-10 10:55:35 -07:00 |
|
|
Woosuk KwonandOpenAI Codex
|
79c865b838
|
[Perf] Narrow DeepSeek V4 eager CUDA graph region (#51430)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-10 10:52:10 -07:00 |
|
|
|
21c667aa64
|
[Docker] Cache test dependencies before vLLM install (#51184)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-10 10:34:59 -07:00 |
|
|
wangxiyuanandBenjamin Chislett
|
355a338b8f
|
[BugFix][SpecDecode] Fix dspark parallel_drafting_token_id init bug (#51602)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-08-10 13:33:10 -04:00 |
|
|
Michael Goin
|
3a749ce816
|
[Build] Skip precompiled wheel fetch during metadata hooks (#51424)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-10 09:38:53 -07:00 |
|
|
Lyu, Xudong
|
0e2d78028c
|
[Bugfix][Kimi-K3] Give the AMD packed KDA decode kernel the state-index stride (#51682)
Signed-off-by: Lyu, Xudong <xudong.lyu@amd.com>
|
2026-08-11 00:05:20 +08:00 |
|
|
Juan Pérez de AlgabaandCursor
|
640a09086d
|
Fix DoS via sample-rate forgery bypassing audio decode duration guard (#49948)
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-10 15:49:17 +00:00 |
|
|
fanxingran
|
37fbf52084
|
[ROCm][MLA] [K3] Fix fp8 KV cache decode on the AITER MLA backend (#51011)
Signed-off-by: fanxingran <xingran.fan@amd.com>
|
2026-08-10 11:42:10 -04:00 |
|
|
|
8fea1d306f
|
Fix uniform_random routing simulation to sample without replacement (#43680)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-08-10 15:28:57 +00:00 |
|
|
Francesco FuscoandClaude
|
fac808b36f
|
[Perf][Hybrid] 3D-grid tiling of the state-copy Triton kernels (#49436)
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-10 17:02:49 +02:00 |
|
|
liuzhenwei
|
bd6536071c
|
[XPU][Test] Pin block size in test_multi_connector (#51213)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-08-10 21:57:45 +08:00 |
|
|
pmanczak
|
ec21f61d82
|
[Misc] Enable test_fused_moe_wn16 on XPU (#51672)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-08-10 21:57:02 +08:00 |
|
|
Taneem IbrahimandWentao Ye
|
ea3115e30b
|
[CI] Stabilize DP supervisor lifecycle tests (#51557)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-10 09:13:52 -04:00 |
|
|
Lucas Wilkinson
|
789c4f905e
|
[CI] Bump CUTLASS DSL to 4.6.2 (#51566)
|
2026-08-10 09:06:08 -04:00 |
|
|
Harry Mellor
|
cf8f3a3bb2
|
[2/N] Harden Transformers modelling backend multi-modal path (#51657)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 12:57:12 +00:00 |
|
|
vllmellmandtjtanaa
|
436be94e13
|
[ROCm][Bugfix] Use TCP store when AITER custom all-reduce is enabled (#51635)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-08-10 11:07:14 +00:00 |
|
|
Raj Vijay FirkeandHarry Mellor
|
3dafaef027
|
[Bugfix][Core] Emit --no-{key} for false BooleanOptionalAction flags in YAML config (#51573)
Signed-off-by: Raj Firke <79653531+rajfirke@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 11:05:15 +00:00 |
|
|
efschu
|
900d09f91a
|
[Bugfix][Model] Fix Qwen3.5 MTP for text-only checkpoints (#50734)
Signed-off-by: efschu <51944948+efschu@users.noreply.github.com>
|
2026-08-10 11:04:53 +00:00 |
|
|
Emmanuel Acheampong
|
3a79957b62
|
[Doc] Add Crusoe Managed Inference deployment guide (#49353)
Signed-off-by: Emmanuel Acheampong <achampion.emma@gmail.com>
|
2026-08-10 11:31:34 +01:00 |
|
|
xiangdong
|
51562de5ab
|
[CI][XPU] Add VLLM_DISABLE_COMPILE_CACHE=1 for other random failed cases in Intel GPU CI (#51604)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-08-10 17:32:16 +08:00 |
|
|
|
243c63baf5
|
[V1][Scheduler] Apply Mamba alignment before encoder caps (#51603)
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Akshat Anand <40275336+cipheraxat@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-10 16:37:17 +08:00 |
|
|
Kunshang Ji
|
d89ba6481b
|
[XPU] bump up xpu kernel to v0.1.12.3 (#50441)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-10 16:09:23 +08:00 |
|
|
|
74c94b9f29
|
[CI] Upgrade huggingface-hub to 1.27.0 (#51422)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 08:59:15 +01:00 |
|
|
Harry Mellor
|
70b84f0bcb
|
Fix Gemma 4 for upcoming Transformers version (#49797)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 07:48:26 +00:00 |
|
|
Itay EtelisandItay Etelis
|
81840a172f
|
[KV Connector] Canonical CPU layout for parallelism-agnostic KV offload (#48414)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
|
2026-08-10 10:44:54 +03:00 |
|
|
Andreas KaratzasandMicah Williamson
|
31cd109f18
|
[ROCm][CI] Extend ROCm AITER MHA (FA) coverage (#40958)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
|
2026-08-10 15:35:13 +08:00 |
|
|
Zetian Li - ikunandClaude
|
7303c66f68
|
[Bugfix] Fix lfm2 tool parser dropping calls with brackets or newline… (#48171)
Signed-off-by: Zetian Li <804561096@qq.com>
Co-authored-by: Claude (Anthropic) <noreply@anthropic.com>
|
2026-08-10 15:10:06 +08:00 |
|
|
|
61c1dd0966
|
[EC Connector] Call to EC Connector update_connector_output from scheduler (#49579)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-10 14:25:57 +08:00 |
|
|
|
ba1cdcfcf0
|
[Model][Quantization] Add Ling-3.0-flash-fp8 support (#51265)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-09 23:09:08 -07:00 |
|
|
Isotr0py
|
3b4c86e489
|
[Bugfix][Quantization] Fix fp32 weight scale for mxfp4 quantization and per-expert checkpoint mapping (#51419)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-09 23:08:52 -07:00 |
|
|
Rehan KhanandLi, Jiang <jiang1.li@intel.com>
|
b22afe45ac
|
[CPU] Enable GPTQ and AWQ quantization for s390x (#51148)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-10 11:41:43 +08:00 |
|
|
Li, Jiang
|
7ce84b99ce
|
[CPU] Restore linear dispatch for small unquantized GEMMs (#51379)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-10 11:29:59 +08:00 |
|