Andrey Talman and Andrey Talman
89ac8d971b
[CI][Test] Allow 10% ngram acceptance drop under preemption on CUDA in test_async_scheduling_accuracy ( #60715 )
...
pre-commit / pre-run-check (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Signed-off-by: Andrey Talman <atalman@users.noreply.github.com >
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com >
2026-10-09 16:59:17 +00:00
stefankoncarevic
b74233860d
[CI][ROCm] Wait for VRAM to settle before building LLM in test_full_graph ( #60872 )
...
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com >
2026-10-09 16:48:43 +00:00
Taewoong Kim and Cyrus Leung
75e3b17c05
[Frontend] Add cache salt support to generative scoring ( #60841 )
...
Signed-off-by: Taewoong Kim <ktw2172@gmail.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-10-09 16:07:50 +00:00
90ba2f34b5
[Build] Find compatible published wheels for precompiled installs ( #58871 )
...
Signed-off-by: greg pereira <grpereir@redhat.com >
Signed-off-by: mgoin <mgoin64@gmail.com >
Co-authored-by: mgoin <mgoin64@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 08:05:54 -07:00
Abhijit Roy
970dc63478
[Docs] Add Giga-Embeddings bidirectional Qwen3 usage to embed docs ( #60854 )
...
Signed-off-by: Abhijit <abroy@redhat.com >
2026-10-09 14:41:38 +00:00
Taneem Ibrahim
a6b39f0262
[Bugfix] Clean up async client sockets after event loop closure ( #57757 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-10-09 10:32:47 -04:00
Warren Deng and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
fc39317392
[Bugfix][Kernel] Remove invalid NC from Kimi-K3 KDA autotune keys ( #60446 )
...
Signed-off-by: Warren Deng <warrdeng@meta.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-10-09 14:25:41 +00:00
Juan Pérez de Algaba and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
3d52578e13
[Security] Do not retain Phi-4 MM audio attention matrices ( #60614 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-10-09 22:23:35 +08:00
Mikko Tukiainen and Cursor
81c993658e
[ROCm][Perf] Fuse main QK-norm/RoPE/gate and KV-cache write into the AMD QSA prepare launch ( #59732 )
...
Signed-off-by: Mikko Tukiainen <Mikko.Tukiainen@amd.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-10-09 21:14:49 +08:00
Li, Jiang
9adba10f3f
[Bugfix] Fix pre-commit check ( #60840 )
...
Signed-off-by: jiang1.li <jiang1.li@intel.com >
2026-10-09 12:48:32 +00:00
Suraj Sharan and linitra24
1ee69dde9c
[Bugfix][LoRA] Reject PEFT adapter features vLLM does not implement ( #60225 )
...
Signed-off-by: suraj <surajsharan85@gmail.com >
Co-authored-by: linitra24 <renshuang.zhou@daocloud.io >
2026-10-09 16:39:58 +04:00
Yan Ma
c17fadcfdc
[XPU] fix fused_input_norm for MM ( #59865 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-10-09 20:16:35 +08:00
YiSheng5 and Kunshang Ji
0cc0460870
[XPU]Fix the accuracy issue when meet topk_ids=-1 on DP+EP scenarios ( #57787 )
...
Signed-off-by: yisheng <yi.sheng@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-10-09 20:01:54 +08:00
Louie Tsai
196483e25b
[Tools] Recipes sweep workflow ( #57307 )
...
Signed-off-by: louie-tsai <louie.tsai@intel.com >
2026-10-09 19:44:09 +08:00
Praneeth Reddy A and Li, Jiang <jiang1.li@intel.com>
1c47ebfc57
[Docs] Fix VLLM_CPU_KVCACHE_SPACE default and units ( #60053 )
...
Signed-off-by: Praneeth <praneethreddyarikatla@gmail.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
2026-10-09 19:43:55 +08:00
Chen Cheng and Isotr0py
d095e61c0b
[Bugfix][Spec Decode] Fix GLM-5.3-Flash DFlash2/EAGLE3 aux hidden-state capture with the upstream config ( #60763 )
...
Signed-off-by: Chen Cheng <85005591+ischencheng@users.noreply.github.com >
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-10-09 11:35:48 +00:00
wang.yuqi
7368fadebd
[CI Failure] Move MTEB tests to h200_35gb ( #60817 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-10-09 11:34:38 +00:00
Luca Motz and Claude Opus 5.5
83ed0c7c09
[Bugfix][NIXL] Fix receive post-process for different P/D block sizes ( #58860 )
...
Signed-off-by: Luca Motz <luca.motz@icloud.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 19:30:11 +08:00
Shreyansh Jain and Artem Perevedentsev
28d76f3bad
[Bugfix][Structured Output] Reject unsupported regex inside groups ( #60359 )
...
Signed-off-by: Shreyansh Jain <shreyanshjain646@gmail.com >
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com >
2026-10-09 14:16:13 +03:00
Chaojun Zhang
b027ac8312
[XPU] Support register KV offload mmap region as pinned host memory on XPU ( #51956 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
2026-10-09 18:58:07 +08:00
5cadabfafd
[Docs] Add Qwen2.5-Coder-7B-Instruct to batch invariance tested models ( #46368 )
...
Signed-off-by: Yuval Luria <yluria@redhat.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-10-09 10:41:29 +00:00
Yan Ma
4e318ac563
[XPU] fix online fp8_per_channel quantization ( #56027 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-10-09 18:38:01 +08:00
Thang Nguyen and Claude Opus 5.5
efd141047d
[CI] Enroll a third batch of five steps in automatic sharding ( #60757 )
...
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 03:26:47 -07:00
Thang Nguyen and Claude Opus 5.5
b8bd335754
[CI] Enroll five more steps in automatic sharding ( #60662 )
...
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 03:26:27 -07:00
Warren Deng
59ffd73e85
[Bugfix][Kernel] Restore FP fusion for indexer Q quantization ( #60716 )
...
Signed-off-by: Warren Deng <warrdeng@meta.com >
2026-10-09 09:46:41 +00:00
Damien Laine and Cyrus Leung
2186b89a9a
[Bugfix][Model] Voxtral realtime: fix boot OOM and engine crash at max_model_len ( #45022 )
...
Signed-off-by: Damien Laine <damien.laine@gmail.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-10-09 17:40:29 +08:00
Harry Mellor and Claude Opus 5.5
2c99ee9333
[Chore] Remove vendored code made redundant by Transformers 5.16.1 ( #60623 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 09:29:03 +00:00
Chao Lei
bc713cf8cc
[Bugfix]MooncakeConnect add query timeout and retry ( #55923 )
2026-10-09 09:19:33 +00:00
Taewoong Kim and Chauncey
18c19eaf23
[Frontend] Add cache salt and tracing to structured decisions ( #60786 )
...
Signed-off-by: Taewoong Kim <ktw2172@gmail.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-10-09 08:53:50 +00:00
a6f43e57d6
[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm ( #59523 )
...
Signed-off-by: aoshen02 <aoshen@inferact.ai >
Signed-off-by: indianspeedster <cspandey016@gmail.com >
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com >
Co-authored-by: indianspeedster <cspandey016@gmail.com >
2026-10-09 08:29:55 +00:00
The Anh Nguyen
bacbbe1878
[Bugfix][NIXL] Guard record_transfer against None telemetry ( #57734 )
...
Signed-off-by: The Anh Nguyen <ntheanh201@gmail.com >
2026-10-09 08:22:18 +00:00
Sriram Kumar
560fae64cd
[ROCm][Bugfix] Pass per-sequence context lengths to the AITER paged MQA-logits kernels ( #59420 )
...
Signed-off-by: Sriram Kumar <sriramkumar.kishorekumar@amd.com >
2026-10-09 08:16:20 +00:00
Maroon Ayoub and Claude
8a03ccf7b3
[Frontend] Add return_mm_kwargs to render requests ( #60728 )
...
Signed-off-by: Maroon Ayoub <mayoub@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-10-09 08:14:13 +00:00
f43e4c39e3
[Structured Output] Allow propertyNames with additionalProperties on xgrammar ( #57594 )
...
Signed-off-by: errmakov <ide404@gmail.com >
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com >
2026-10-09 10:49:47 +03:00
efaca9547d
[Perf][DSv4.1] Exchange packed FP8 Engram rows across DP and feed wkv MXFP8 ( #59923 )
...
Signed-off-by: Juntian Liu <Juntianl777@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-10-09 15:30:18 +08:00
82e89e9944
[Perf][Qwen4Exp] Retune H200 M=4 merged QSA LL-GEMM plan ( #60776 )
...
Signed-off-by: zigzagcai <zigzagcai@users.noreply.github.com >
Co-authored-by: zigzagcai <zigzagcai@users.noreply.github.com >
Co-authored-by: Claude Code <noreply@anthropic.com >
2026-10-09 07:18:50 +00:00
19c0bed584
[Fusion] Support 3D activation quantization fusion and enable it for Pixtral ( #59612 )
...
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Misha Goin <mgoin64@gmail.com >
2026-10-09 15:12:03 +08:00
dd30786fef
[CI] Enable Zen CPU image build on AMD CI ( #60016 )
...
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Micah Williamson <micah.williamson@amd.com >
2026-10-09 01:40:21 -05:00
Paweł Mańczak and Kunshang Ji
f0a5f111f2
[XPU] Add tuned Mamba SSU configs for Intel Arc Pro B60 ( #56765 )
...
Signed-off-by: pmanczak <pawel.manczak@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-10-09 14:29:29 +08:00
ad73a4740d
[Perf][DSv4.1] Trim the last KV-source layer in decoder replay ( #59894 )
...
Signed-off-by: Canlin <canlinguosdu@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Juntian Liu <Juntianl777@gmail.com >
2026-10-09 06:07:49 +00:00
8cbd5d0300
[Frontend] structured decisions: noul and score question types ( #60696 )
...
Signed-off-by: Matt Mastracci <matthew@mastracci.com >
Co-authored-by: DeepSeek <noreply@deepseek.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Misha Goin <mgoin64@gmail.com >
2026-10-09 04:48:16 +00:00
Rohan Potdar and Claude Opus 5.5
88a419649e
[ROCm][Kimi-K3] Use vLLM's FP8 max in the fused AttnRes quantization ( #60717 )
...
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 04:45:13 +00:00
fa312090cb
[Frontend] Accept each connection on the least loaded API worker ( #60723 )
...
Signed-off-by: hao-aaron <aaronhao@inferact.ai >
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 04:40:13 +00:00
Rajeev Warrier
81d9c45e4b
[Docs] [Multimodal] Note that per-request media_io_kwargs needs --trust-request-mm… ( #60598 )
...
Signed-off-by: Rajeev Warrier <warrier.rajeev.95@gmail.com >
2026-10-09 04:23:07 +00:00
e31b823bf5
[Bugfix][Tool Parser] Use LongCat tags in the LongCat structural tag ( #60747 )
...
Signed-off-by: hpdkhoa <hpdkhoa2311@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-08 21:20:54 -07:00
9824159d94
[Bugfix] Fix InternLM2 tool parser dropping characters from streamed arguments ( #60709 )
...
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-08 21:20:49 -07:00
Vineeth Sai Varikuntla and Flora Feng
112a282915
[Bugfix][Frontend] Keep streamed completion text_offset in step with tokens ( #60668 )
...
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-08 21:20:43 -07:00
51ef239768
[Rust Frontend] Carry reasoning controls over gRPC ( #59836 )
...
Signed-off-by: Alec Flowers <aflowers@nvidia.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 11:11:19 +08:00
Rémi Delhaye
a1cd0ec650
[Model] Add zerank-2 reranker ( #60415 )
...
Signed-off-by: rdlhio <contact@rdlh.io >
2026-10-09 03:01:51 +00:00
zzaebok and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
702ce313f4
[Perf][Multimodal] Sort multimodal encoder inputs by modality ( #60196 )
...
Signed-off-by: Jaebok Lee <jaebok9541@naver.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-10-09 10:55:36 +08:00
