 San-Nguyen
|
e729cc823d
|
[Fix] Add Spacing when Requesting Output Token > max_model_len (#40324)
Signed-off-by: San-Nguyen <san.nguyen@ibm.com>
|
2026-04-20 00:25:06 -07:00 |
|
|
velonica0
|
ec7aafc02a
|
[CPU][RISC-V] Support multiple RVV VLEN targets via compile-time dispatch (#39478)
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
|
2026-04-20 14:36:59 +08:00 |
|
|
Julien Denize
|
6097afb9bd
|
[BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916)
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
|
2026-04-19 22:25:03 -07:00 |
|
|
Chaojun ZhangandKunshang Ji
|
4f4713f96e
|
[XPU] [torch.compile] Skipping CUDA graph memory estimation to avoid startup errors. (#39977)
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-20 13:04:39 +08:00 |
|
|
Tao He
|
8936118134
|
[Qwen][Bugfix] Fixes sigmoid activation in torch impl of RMSNormGated. (#40245)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
|
2026-04-20 04:28:19 +00:00 |
|
|
Yuan Tang
|
67ed01c353
|
fix: Do not make function calls when request has no tools for /v1/responses (#40314)
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
|
2026-04-20 04:17:30 +00:00 |
|
|
Hoang NguyenandClaude
|
6e10cb54f6
|
[Bugfix][Responses API] Fix streaming tool calls on /v1/responses (#39892)
Signed-off-by: Hoang Nguyen <118159510+hnt2601@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-20 11:24:52 +08:00 |
|
|
Shinichi Hemmiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
fcb31c1ac3
|
[Bugfix] Properly initialize PerTensorScaleParameter for fused-on-disk checkpoints (#39765)
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-20 02:53:04 +00:00 |
|
|
Lxx
|
d886c26d4d
|
[Doc] Fix typos in token_embed pooling documentation (#40266)
Signed-off-by: YifanLi3 <lyfqlx3@gmail.com>
|
2026-04-19 19:27:32 -07:00 |
|
|
Liangliang MaandKunshang Ji
|
898beca5a8
|
[BugFix][XPU] fix lora ops bgmv_expand size not match (#39989)
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-20 08:24:50 +08:00 |
|
|
Kevin H. Luu
|
629d45eacb
|
[ci] Make ecr authenticate non blocking (#40305)
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-04-19 15:37:53 -07:00 |
|
|
Andrew Barnes
|
f150107efd
|
[ROCm] Fix cu_seqlens_q off-by-one in AITER FA speculative decode path (#39120)
Signed-off-by: Bortlesboat <bortstheboat@gmail.com>
|
2026-04-19 18:34:33 +00:00 |
|
|
danisereb
|
d1135a5087
|
Fix MoE backend selection for LoRA (unquantized MoE) (#40273)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
|
2026-04-19 17:18:40 +00:00 |
|
|
Netanel Haberandmilesial
|
982beae809
|
Optimize nemotron VL image/video preprocessing (#40283)
Signed-off-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: milesial <milesial@users.noreply.github.com>
|
2026-04-19 15:06:20 +00:00 |
|
|
TJian
|
45232a454e
|
[FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-04-19 09:57:39 +00:00 |
|
|
Flora Feng
|
03ce1c6ed9
|
[Bugfix] Kimi-K2 tool parser streaming - fix token leakage, argument truncation, and content dropping (#38579)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-04-19 01:30:27 -07:00 |
|
|
omerpaz95
|
4353c9cb4a
|
[KV Offload] Pass request context (#39185)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
|
2026-04-19 08:54:59 +03:00 |
|
|
omerpaz95andOr Ozeri
|
4b7f5ea1a0
|
[KV Connector] Allow metrics of multiple connectors of same types in multi connector. (#40010)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-04-19 07:49:10 +03:00 |
|
|
|
38907e4391
|
[Frontend] Preserve structured output special tokens in offline LLM.chat (#39352)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-04-18 19:46:07 -04:00 |
|
|
|
d0359f3e04
|
[Bugfix] Guard mxfp4_experts_quant bindings on ENABLE_NVFP4_SM100 (#40191)
Signed-off-by: ultranationalism <www913363043@gmail.com>
Signed-off-by: mgoin <mike.goin12@gmail.com>
Co-authored-by: mgoin <mike.goin12@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-18 13:58:46 -07:00 |
|
|
Dan Alistarh
|
ed0622e3a8
|
[Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194)
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com>
|
2026-04-18 14:31:59 -04:00 |
|
|
Yusuf Mohammad
|
b5f6c5f834
|
Added general ND x ND matmul and unit test for it (#39909)
Signed-off-by: Yusuf <yusufmohammad@live.com>
|
2026-04-18 10:05:21 -04:00 |
|
|
Jee Jee Li
|
bfde49e287
|
[DOC] Add fuse_minimax_qk_norm (#39782)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-04-18 00:41:37 -07:00 |
|
|
Nick CaoandClaude
|
153ba7f0f3
|
[Refactor] Drop direct dependency on librosa (#39079)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-18 06:55:38 +00:00 |
|
|
Chinmay-Kulkarni-AMD
|
87518c3027
|
[ZenCPU] AMD Zen CPU Backend with supported dtypes via zentorch weekly (#39967)
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
|
2026-04-18 06:22:37 +00:00 |
|
|
Rishapveer Singh
|
aeee7ef939
|
[Bugfix] Fix k_proj's bias for GLM-ASR (#40160)
Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>
|
2026-04-17 22:34:33 -07:00 |
|
|
z1ying
|
cda19ecf4d
|
[Doc] Fix outdated source reference comment in anthropic/serving.py (#40189)
Signed-off-by: z1ying <tzzying@outlook.com>
|
2026-04-17 22:31:13 -07:00 |
|
|
Nithin ChalapathiandCyrus Leung
|
80b18230e0
|
[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405)
Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com>
Signed-off-by: Nithin Chalapathi <nithinc@berkeley.edu>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-04-17 20:31:56 -07:00 |
|
|
z1ying
|
d0697cc7b6
|
[Doc] Add Realtime Transcription section to supported_models.md (#39845)
Signed-off-by: Ziying Tao <tzzying@outlook.com>
|
2026-04-18 03:26:14 +00:00 |
|
|
milesialandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
b0755523dc
|
[Core] Reduce mm scheduler, get_num_embed overhead (#40143)
Signed-off-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-18 11:25:49 +08:00 |
|
|
Chaojun Zhangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
993859ceb0
|
[XPU] fix all_reduce all-zero accuracy issue under torch.compile (#39844)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-04-18 02:33:07 +00:00 |
|
|
Michael Goin
|
48a65ccb02
|
[CI] Speed up test_fused_marlin_moe (#40178)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
|
2026-04-17 19:26:21 -07:00 |
|
|
Xinyu ChenandKunshang Ji
|
55842a8d69
|
[XPU]fake impl for xpu fp8_gemm (#39984)
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-18 08:53:56 +08:00 |
|
|
Michael Goin
|
1f45e83756
|
Remove outdated tests test_mixtral_moe and test_duplicated_ignored_sequence_group (#40175)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-04-17 16:49:43 -07:00 |
|
|
Michael Goin
|
a8bffaa133
|
[Kernel] Add MXFP4 W4A4 CUTLASS MoE kernel for SM100 (#37463)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-04-17 16:42:32 -07:00 |
|
|
Yanan CaoandClaude Sonnet 4
|
5cdddddd4a
|
[Kernel] [Helion] Force disable HOP path due to performance regression (#40171)
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
|
2026-04-17 17:36:49 -04:00 |
|
|
aditi-amd
|
6ef1efd51f
|
[ROCm] Fix TurboQuant on ROCm: backend routing, flash-attn compat, int64 overflow (#39953)
Signed-off-by: aditi <aditi.rana@amd.com>
|
2026-04-17 13:08:37 -07:00 |
|
|
Ryan Rock
|
58da4ee047
|
[AMD][CI] Update DeepEP branch (#38396)
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
|
2026-04-17 14:30:20 -05:00 |
|
|
Andreas Karatzas
|
1ae11e2bfc
|
[ROCm][CI] Build fastsafetensors from source so it links against libamdhip64 (#39978)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-04-17 14:30:08 -05:00 |
|
|
Xinyu ChenandKunshang Ji
|
251c18d1f8
|
skip fp8e4b15 on xpu (#39957)
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-17 16:55:08 +00:00 |
|
|
Roger WangandChauncey
|
512765d52d
|
[Misc][UX] Map mimo reasoning and tooling parsers (#40089)
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-04-17 16:49:21 +00:00 |
|
|
allgatherandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
640cc9dd7d
|
feat: Add LoRA support for Gemma4ForConditionalGeneration (#39291)
Signed-off-by: allgather <all2allops@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-04-17 09:39:19 -07:00 |
|
|
Jared Wenandsfeng33
|
ceade1952c
|
[BugFix] Support custom tool parsers when tool_choice is required and named function (#39870)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-04-17 16:38:10 +00:00 |
|
|
Jing WangandCopilot
|
747256bb5d
|
[Bugfix][Core] Fix stuck chunked pipeline parallelism with async scheduling (#38726)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-04-17 16:02:50 +00:00 |
|
|
Michael Goin
|
1174723eba
|
Fix TURBOQUANT backend selection in cuda.py (#40060)
Signed-off-by: Michael Goin <mgoin64@gmail.com>
|
2026-04-17 07:31:41 -07:00 |
|
|
sychen52
|
6b2b7bd0eb
|
Add nvfp4 support to reshape_and_cache_flash (#37332)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
|
2026-04-17 07:28:00 -07:00 |
|
|
Ben Browning
|
70770268c3
|
Add @bbrowning to CODEOWNERS (#40141)
Signed-off-by: Ben Browning <bbrownin@redhat.com>
|
2026-04-17 09:51:48 -04:00 |
|
|
Chauncey
|
7a51b3e415
|
[Bugfix] Fix empty delta detection in Qwen3XMLToolParser streaming (#40090)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-04-17 13:34:55 +00:00 |
|
|
Li, Jiang
|
d02421a7db
|
[CPU] Refactor CPU affinity and memory management (#39781)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-04-17 21:01:08 +08:00 |
|
|
Lukas Geiger
|
b1dc87a098
|
[Models][Gemma4] Prevent GPU/CPU sync in embed_input_ids (#39234)
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
|
2026-04-17 12:37:21 +00:00 |
|