Julien Denize
6097afb9bd
[BUGFIX] Fix Pixtral consolidated format vision weight loading ( #39916 )
...
Signed-off-by: Julien Denize <julien.denize@mistral.ai >
Signed-off-by: juliendenize <julien.denize@mistral.ai >
2026-04-19 22:25:03 -07:00
Hoang Nguyen and Claude
6e10cb54f6
[Bugfix][Responses API] Fix streaming tool calls on /v1/responses ( #39892 )
...
Signed-off-by: Hoang Nguyen <118159510+hnt2601@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-20 11:24:52 +08:00
danisereb
d1135a5087
Fix MoE backend selection for LoRA (unquantized MoE) ( #40273 )
...
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com >
2026-04-19 17:18:40 +00:00
TJian
45232a454e
[FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton ( #39083 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-04-19 09:57:39 +00:00
Flora Feng
03ce1c6ed9
[Bugfix] Kimi-K2 tool parser streaming - fix token leakage, argument truncation, and content dropping ( #38579 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-04-19 01:30:27 -07:00
omerpaz95
4353c9cb4a
[KV Offload] Pass request context ( #39185 )
...
Signed-off-by: omerpaz95 <omerpaz95@gmail.com >
2026-04-19 08:54:59 +03:00
Dan Alistarh
ed0622e3a8
[Attention] TurboQuant: remove redundant random signs, add prior art attribution ( #40194 )
...
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com >
2026-04-18 14:31:59 -04:00
Yusuf Mohammad
b5f6c5f834
Added general ND x ND matmul and unit test for it ( #39909 )
...
Signed-off-by: Yusuf <yusufmohammad@live.com >
2026-04-18 10:05:21 -04:00
Nick Cao and Claude
153ba7f0f3
[Refactor] Drop direct dependency on librosa ( #39079 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-18 06:55:38 +00:00
Nithin Chalapathi and Cyrus Leung
80b18230e0
[Frontend] Add multimodal support to /inference/v1/generate endpoint ( #38405 )
...
Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com >
Signed-off-by: Nithin Chalapathi <nithinc@berkeley.edu >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-04-17 20:31:56 -07:00
milesial and gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
b0755523dc
[Core] Reduce mm scheduler, get_num_embed overhead ( #40143 )
...
Signed-off-by: milesial <milesial@users.noreply.github.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-04-18 11:25:49 +08:00
Michael Goin
48a65ccb02
[CI] Speed up test_fused_marlin_moe ( #40178 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
Signed-off-by: Michael Goin <mgoin64@gmail.com >
2026-04-17 19:26:21 -07:00
Michael Goin
1f45e83756
Remove outdated tests test_mixtral_moe and test_duplicated_ignored_sequence_group ( #40175 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
2026-04-17 16:49:43 -07:00
Michael Goin
a8bffaa133
[Kernel] Add MXFP4 W4A4 CUTLASS MoE kernel for SM100 ( #37463 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
2026-04-17 16:42:32 -07:00
Xinyu Chen and Kunshang Ji
251c18d1f8
skip fp8e4b15 on xpu ( #39957 )
...
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
2026-04-17 16:55:08 +00:00
sychen52
6b2b7bd0eb
Add nvfp4 support to reshape_and_cache_flash ( #37332 )
...
Signed-off-by: Shiyang Chen <shiychen@nvidia.com >
2026-04-17 07:28:00 -07:00
Chauncey
7a51b3e415
[Bugfix] Fix empty delta detection in Qwen3XMLToolParser streaming ( #40090 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-04-17 13:34:55 +00:00
Li, Jiang
d02421a7db
[CPU] Refactor CPU affinity and memory management ( #39781 )
...
Signed-off-by: jiang1.li <jiang1.li@intel.com >
2026-04-17 21:01:08 +08:00
Shinichi Hemmi
4c47710bf7
[CI/Build] Apply ruff formatter to pass pre-commit ( #40078 )
...
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp >
2026-04-17 08:54:32 +08:00
bnellnm
79e799ebbd
[Bugfix] Temporarily disable B200 fp4 MoE layer tests ( #40057 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-04-16 19:26:55 -04:00
BadrBasowid
29057d3bee
[Compilation] Add Unit Tests for VllmFusionPatternMatcherPass ( #39692 )
...
Signed-off-by: BadrBasowid <badr.basowid@gmail.com >
2026-04-16 22:57:16 +00:00
Asaf Gardin
ad2b1277f9
[Quantization] Consolidate experts_int8 with fp8 online quantization ( #38463 )
...
Signed-off-by: Josephasafg <ajgard7@gmail.com >
2026-04-16 13:12:20 -07:00
roikoren755
b897f00c9c
Gate SSU dispatch setup ( #40039 )
...
Signed-off-by: Roi Koren <roik@nvidia.com >
2026-04-16 13:06:01 -07:00
adf9bb3c57
[CI] Add weight transfer tests to CI ( #39821 )
...
Signed-off-by: SumanthRH <sumanthrh99@gmail.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-04-16 15:51:45 -04:00
Roger Wang
3abb7560c0
[Bugfix] Fix audioflamingo test ( #40052 )
...
Signed-off-by: Roger Wang <hey@rogerw.io >
2026-04-16 11:53:58 -07:00
Nikita Shapovalov
692db29cd4
[Bugfix] Fix Ray compiled-DAG SHM channel stalls by detaching zero-copy np.ndarray logprobs buffers ( #35736 )
...
Signed-off-by: Nikita Shapovalov <nikita@poolside.ai >
2026-04-16 23:49:29 +08:00
Nicolò Lucchesi
3daca38e22
[Misc] toy_proxy_server handle min_tokens ( #39706 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-04-16 15:08:22 +00:00
daiyu1111
a302a8fd1b
[Bugfix] Fix LLM priority normalization for single-string prompts ( #40011 )
...
Signed-off-by: daiyu1111 <2356690121@qq.com >
2026-04-16 07:56:06 -07:00
Li, Jiang
324a3d2bd8
[CI/Build] Improve stability of CPU tests ( #39966 )
...
Signed-off-by: jiang1.li <jiang1.li@intel.com >
2026-04-16 21:50:36 +08:00
grYe99 and grYe99
4269b79409
[Model] Use mm_features to compute mrope positions for PaddleOCR-VL ( #39888 )
...
Signed-off-by: grYe99 <guorongye99@gmail.com >
Co-authored-by: grYe99 <guorongye99@gmail.com >
2026-04-16 06:14:00 -07:00
Yanan Cao and Claude Opus 4.6
edc3648966
[Kernel][Helion] Fix inductor fusion of Helion HOP ( #39944 )
...
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-16 04:41:26 -07:00
lalit10
17d87168d2
[Model] Use mm_features for Keye-VL and Keye-1.5-VL M-RoPE ( #39869 )
...
Signed-off-by: Lalit Laxminarayan Bangad <lalitbangad@gmail.com >
2026-04-16 02:16:06 -07:00
Abhijit Roy and wang.yuqi
2cdf86044d
Add Jina Embeddings v5 model support ( fixes #38633 ) ( #39575 )
...
Signed-off-by: Abhijit <abroy@redhat.com >
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-04-16 06:37:10 +00:00
realliujiaxu
7845379230
[Bugfix] add support for 'num_attention_groups' in ModelArchConfigConvertorBase for Step3p5 ( #39796 )
...
Signed-off-by: realliujiaxu <realliujiaxu@163.com >
2026-04-16 05:48:00 +00:00
Fadi Arafeh and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
445b7093fd
[perf][cpu] Accelerate BF16 GELU with LUT impl on Arm CPUs ( #37469 )
...
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-15 22:26:17 -07:00
jigangz and Claude
18013df6ae
[Bugfix] Reject empty tools array with HTTP 400 ( #39780 )
...
Signed-off-by: Jigang Zhou <zjg0907008@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-16 12:08:04 +08:00
Julien Denize
c0722f22de
[Mistral Grammar] Fix tool and reasoning parsing ( #39217 )
...
Signed-off-by: juliendenize <julien.denize@mistral.ai >
2026-04-15 21:05:04 -07:00
vllmellm
5f7fab881a
[ROCm][FEAT] Integrate aiter gemm w8a8 ptpc ( #33773 )
...
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com >
2026-04-16 09:55:29 +08:00
Asaf Gardin
19fa90ed0d
[Quantization] - Layerwise reloading of Attention/KV quantized models ( #38995 )
...
Signed-off-by: Josephasafg <ajgard7@gmail.com >
2026-04-15 18:03:32 -07:00
03f8d3a548
Update to transformers v5 ( #30566 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: khluu <khluu000@gmail.com >
Signed-off-by: Kevin H. Luu <khluu000@gmail.com >
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
Co-authored-by: khluu <khluu000@gmail.com >
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
Co-authored-by: jiang1.li <jiang1.li@intel.com >
2026-04-15 16:29:15 -07:00
Collin McCarthy
27c0ca50a0
Update registry for Nemotron-v3 VL Nano/Super ( #39747 )
...
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com >
2026-04-15 16:09:11 -07:00
Wentao Ye
7c636432c6
[CI Bug] fix flaky test ( #39938 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-04-15 17:20:06 -04:00
Wentao Ye
39ac640490
[Bug] Fix batch invariant test issue, bs=1 with max_seq_num = 1 ( #39320 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-04-15 16:28:43 -04:00
zhanqiuhu
0b790a2501
[Speculative Decoding] Add DFlash speculators config parsing ( #38300 )
...
Signed-off-by: Zhanqiu Hu <zhu@redhat.com >
2026-04-15 16:22:15 -04:00
zhanqiuhu
41488f2acd
[Bugfix][NIXL] Fix _logical_to_kernel_block_ids conversion for non-mamba models ( #39724 )
...
Signed-off-by: Zhanqiu Hu <zhu@redhat.com >
2026-04-15 20:08:58 +00:00
55e1a8e103
[Mooncake] Fix mixed MLA+Eagle block-size validation ( #39596 )
...
Signed-off-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-15 11:36:47 -07:00
Mark McLoughlin
8ad6ff0037
[Test] Fix @create_new_process_for_each_test("fork") in interactive shell pipeline ( #29130 )
...
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
2026-04-15 12:22:20 -04:00
Chauncey
db8d4a4a06
[BugFix][Graph] fix: handle empty sym_shape_indices in PiecewiseBackend. ( #39395 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-04-15 09:28:09 -04:00
Csrayz
68be0f853e
[Metrics] Add request_id to FinishedRequestStats to enable correlation between metrics and requests ( #39710 )
...
Enables external `StatLogger` plugins to correlate per-request metrics
with request-level context. Also, this is a pre-requisite for Prometheus
exemplars in #30972 .
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com >
2026-04-15 11:24:17 +00:00
Zhenzhong Xu
60995c05b4
[Quantization][Autoround][CPU] Add W4A16 Support ( #38192 )
...
Signed-off-by: Zhenzhong1 <zhenzhong.xu@intel.com >
Signed-off-by: Zhenzhong Xu <zhenzhong.xu@intel.com >
2026-04-15 18:38:31 +08:00
Julien Denize