 Thien TranandCodex
|
d125b540b7
|
[Agents] Add CUDA IMA debugging skill (#53702)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 18:09:24 -07:00 |
|
|
Wentao Ye
|
a447955aca
|
[Kimi Bug] Fix k3 torch.AcceleratorError: CUDA error: an illegal memory access was encountered (#53773)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 17:38:48 -07:00 |
|
|
Canlin Guo
|
bc2d63e650
|
[Kimi K3][Kernel] Enable low-latency decode GEMM dispatch on SM100 (#53534)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-25 16:32:28 -07:00 |
|
|
Almog Tavor
|
bc39ded3c4
|
[Bugfix][KV Offload] Defer request-level cascade of in-flight primary keys (#53329)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-25 23:20:03 +00:00 |
|
|
|
80771bbbdd
|
[Core] Disable fuse_allreduce_rms under VLLM_BATCH_INVARIANT (non-deterministic under TP) (#51292)
Signed-off-by: Don Tolley <tolleybot@gmail.com>
Signed-off-by: tolleybot <tolleybot@gmail.com>
Co-authored-by: yewentao256 <yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 15:16:09 -04:00 |
|
|
Wentao Ye
|
0e30bd62fe
|
[CI Bug] Fix kimi test AssertionError: Aligned Mamba state indices must be precomputed (#53766)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 15:06:14 -04:00 |
|
|
Wentao Ye
|
384d079697
|
[Perf] Autotune batch invariance triton kernel in blackwell, 33.6% E2E latency reduction (#53649)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 15:06:01 -04:00 |
|
|
Nick Hill
|
e6cc0899b6
|
[Bugfix][MRV2] Run cudagraph memory profiling in a throwaway graph pool (#53682)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-25 18:52:15 +00:00 |
|
|
Misha GoinandOpenAI Codex
|
c9331d8064
|
[CI] Preserve Rust Docker cache across commits (#53290)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 11:13:36 -07:00 |
|
|
Moe Huzaifa
|
299ebd094a
|
[Bugfix][Multimodal] Reject malformed base64 audio with 400 instead of 500 (#53744)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 17:31:42 +00:00 |
|
|
Misha Goin
|
7de96050c5
|
[Spec Decode] Enable adaptive DSpark on SM100 sparse MLA (#52783)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-25 13:31:15 -04:00 |
|
|
Wentao Ye
|
70021a0081
|
[Mypy Fix] Mypy fix for "vllm/model_executor/models/[gG]" (#53616)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 09:47:16 -07:00 |
|
|
Moe Huzaifa
|
217a0b5cef
|
[Bugfix][Frontend] Apply the stop string limit to Cohere requests (#53750)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:41:08 +00:00 |
|
|
Moe Huzaifa
|
3e833933dc
|
[Bugfix][Frontend] Keep credentials out of the Rust frontend launch log (#53738)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:32:12 +00:00 |
|
|
Moe Huzaifa
|
19406fae28
|
[Bugfix][Tokenizer] Replace bare asserts in the DeepSeek V4 encoder (#53747)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:30:23 +00:00 |
|
|
Luke Alonso
|
3454335f7b
|
[Bugfix] Resolve B12X modules before Dynamo tracing (#53326)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
|
2026-08-25 09:20:15 -07:00 |
|
|
Colin ZandAndreas Karatzas
|
bc11ecaf4e
|
[CI] Add GSM8K accuracy test for amd/DeepSeek-V4-Flash-MXFP4 (#50632)
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-25 09:06:58 -07:00 |
|
|
Yan Ma
|
10ade93979
|
[XPU] update key supported models (#53494)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-25 15:10:48 +00:00 |
|
|
Wentao Ye
|
41729fc53b
|
[K3 Perf] Optimize k3 mamba metadata preparation, 6.6~7.6x kernel performance improvement (#52388)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-25 11:00:28 -04:00 |
|
|
Naveenraj KamalakannanandBenjamin Chislett
|
d5cadcee86
|
[Feature][DSpark]: Logprobs adaptive verification (#52242)
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-08-25 10:22:33 -04:00 |
|
|
|
ca29cd48ba
|
[Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-25 10:21:00 -04:00 |
|
|
Taneem Ibrahim
|
9c8e90eb26
|
[Bugfix] Handle parenthesized Gemma4 tool calls (#53657)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-25 08:21:42 -04:00 |
|
|
Taneem Ibrahim
|
2014e47485
|
[Pooling UX] Improve serve --task error guidance (#53467)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-25 08:20:10 -04:00 |
|
|
Elvir Crnčević
|
afc91fa0d2
|
[Profiler] Fix start_profile permanently no-op after max_iterations auto-stop (#51839)
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
|
2026-08-25 08:13:29 -04:00 |
|
|
djramic
|
d9fbe526c0
|
[ROCm][CI] Skip ModernBERT FP8 MTEB test when no FP8 ScaledMM kernel exists (#53589)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-08-25 08:07:09 +00:00 |
|
|
Tianyu Guo
|
12c84b98dd
|
[Config][EC] Normalize producer-only encoder config (#53656)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-25 07:53:04 +00:00 |
|
|
Jiahao LiangandChauncey
|
59d7fc92ea
|
[Bugfix][DeepSeek V4] Handle trailing system messages in prompt rendering (#51262)
Signed-off-by: jiahaoliang <gzliangjiahao@gmail.com>
Signed-off-by: Jiahao Liang <gzliangjiahao@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-08-25 07:49:44 +00:00 |
|
|
Ning Xie
|
23310bc3de
|
[sleep functionality] code refactor about sleep/wake_up (#50431)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-25 07:45:20 +00:00 |
|
|
Thien TranandCodex
|
5e379a361e
|
[Agents] Add kernel microbenchmark skill (#53688)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 07:25:27 +00:00 |
|
|
Jiatai WangandOpenAI Codex
|
06ecec7a84
|
[Bugfix][MM] Fix JinaVL processing cache order (#53553)
Signed-off-by: JiataiWang <wangjiatai@proton.me>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 00:03:05 -07:00 |
|
|
wang.yuqi
|
735daf8ef6
|
[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-25 07:02:32 +00:00 |
|
|
|
c74dd2d208
|
[Bugfix][MRV2] Dispatch uniform decode to a padded FULL cudagraph (#53407)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: xiaohuguo2023 <149615094+xiaohuguo2023@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-08-25 06:59:38 +00:00 |
|
|
Louie Tsai
|
4af586e185
|
Vllm recipes tool improve (#53325)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-08-25 05:53:47 +00:00 |
|
|
|
48d7132962
|
[Model] Migrate FlexOlmo, Olmo3 and Hunyuan V1/VL to the Transformers modeling backend (#53615)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 22:39:05 -07:00 |
|
|
Seunghyuk Park (shepark)
|
4f3e255dca
|
[Bugfix][Model] deepseek-vl2: restore original DeepseekV2Config defaults for omitted language_config fields (#51302)
Signed-off-by: Seunghyuk Park <separk@habana.ai>
|
2026-08-25 05:03:40 +00:00 |
|
|
Karan Shelar
|
a9a17e7095
|
Dflash2 load fix (#53435)
|
2026-08-24 21:32:43 -07:00 |
|
|
|
1f9444a34f
|
[Rust Frontend][gRPC] Add LoRA lifecycle control (#52840)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-25 04:13:19 +00:00 |
|
|
|
af119619c4
|
Exclude the cpu backend from vLLM's active-Triton-driver count (#53530) (#53530)
Signed-off-by: Minjang Kim <minjang@meta.com>
Co-authored-by: Autopilot Bot <noreply+1608173377072046@fb.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-25 04:13:13 +00:00 |
|
|
|
8fe9317f2e
|
[Model][MoE] DeepSeek-V4: add opt-in FlashInfer moe_ep expert backend (#49636)
Signed-off-by: Md Saidul Hoque Anik <mhoqueanik@nvidia.com>
Signed-off-by: Anerudhan Gopal <agopal@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Anerudhan Gopal <agopal@nvidia.com>
|
2026-08-25 03:35:01 +00:00 |
|
|
Moe Huzaifa
|
d3e2888c75
|
[Bugfix][Frontend] Redact hf_token in the non-default args log (#53625)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 03:06:46 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
b2dd9ce73d
|
[Docs] Fix docstring continuation indentation in routed_experts.py (#53604)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-25 02:27:16 +00:00 |
|
|
Ziming HuangandRoger Wang
|
d4c4ceb31e
|
[Bugfix][NIXL] Fix Mamba prefill truncation ordering (#53523)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-24 19:13:27 -07:00 |
|
|
Libin TangandKunshang Ji
|
cbe3966f9c
|
[XPU] Fix sparse-MLA metadata sync (#52066)
Signed-off-by: Libin Tang <libin.tang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-25 02:05:35 +00:00 |
|
|
Zupeng Wang
|
7b7e5cbfcd
|
[Bugfix][LoRA] Restore tower and connector LoRA support for LFM2-VL (#53519)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
|
2026-08-25 01:53:04 +00:00 |
|
|
Kevin H. LuuandCodex
|
34c3824a11
|
[CI] Increase Entrypoints Unit timeout after launcher suite growth (#53618)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 01:48:57 +00:00 |
|
|
kiroxuandOpenAI Codex
|
07ef21bc69
|
[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-24 18:28:49 -07:00 |
|
|
drakoshaandClaude
|
9bf0d4717e
|
[Bugfix] Keep grid dims for XD-RoPE models on a prefix-cache hit (#53456)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-25 01:14:32 +00:00 |
|
|
Nick Hill
|
09fddeb4ce
|
[Bugfix] BailingMoeV3 KDA: skip absent metadata during CUDA graph profiling (#53593)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-25 01:02:50 +00:00 |
|
|
Andrey Talman
|
e3dde1ee9b
|
[CI] Report torch-nightly results to PyTorch CRCR (#51830)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-08-24 18:00:13 -07:00 |
|
|
|
7ca336929c
|
[Model] Remove ten deprecated model architectures (#53608)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-24 17:06:00 -07:00 |
|