|
f6aa2919bc
|
[Bugfix][Core] Keep every multimodal feature in the partial-block KV event (#58288)
Signed-off-by: haosenwang1018 <haosenwang1018@users.noreply.github.com>
Co-authored-by: haosenwang1018 <haosenwang1018@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-24 23:25:01 +00:00 |
|
|
Miłosz Grunwald
|
bd4cb3fe4e
|
[BUGFIX] fix ovis2_5 multimodal tokens (#52623)
Signed-off-by: Milosz Grunwald <milosz.grunwald@intel.com>
|
2026-09-25 07:18:54 +08:00 |
|
|
snadampalandNicolò Lucchesi
|
6a86bf626e
|
[PD][PushConnector] Record last activity of remotes on the D side (#52245)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-09-24 23:15:32 +00:00 |
|
|
Andrey Talman
|
f5b40fcdfe
|
[CI] Report to CRCR after all jobs finish, gated on the build's long pole (#58628)
|
2026-09-24 16:02:30 -07:00 |
|
|
Fanli LinandKunshang Ji
|
7edb27f68e
|
[XPU][CI] enable prompt embeds tests on XPU (#58283)
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-25 06:56:59 +08:00 |
|
|
Jellow
|
e6c07ea576
|
[Bugfix][KV Cache] Fix incremental multimodal block hashing (#51694)
Signed-off-by: Jellow <49915976+CZT0@users.noreply.github.com>
Signed-off-by: Jellow <dvdx@foxmail.com>
|
2026-09-24 15:38:03 -07:00 |
|
|
Nick Hill
|
36f94d5fe8
|
[Bugfix][Outlines] Fix EOS termination and unconstrained masks after rejected drafts (#58612)
|
2026-09-24 21:55:56 +00:00 |
|
|
Juntian LiuandClaude Opus 5.5
|
04730e8270
|
[DFlash] Capture the context K/V precompute in the draft CUDA graph (#57632)
Signed-off-by: Juntian Liu <Juntianl777@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-24 21:38:04 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
e33de821c0
|
[ROCm][CI] skip the ROCm MRV1 default where MRV1 cannot serve the config (#58535)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-24 15:36:36 -05:00 |
|
|
Aaron KangandMisha Goin
|
0908116dd9
|
[Bugfix] Pass quant_config to DiffusionGemma's ParallelLMHead (#48521)
Signed-off-by: Aaron Kang <aaron.h.kang@icloud.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-24 13:17:02 -07:00 |
|
|
|
ab3de6edf2
|
[Perf] DiffusionGemma: constrained reads over the request's logprob_token_ids (#58216)
Signed-off-by: Matt Mastracci <matthew@mastracci.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-24 13:15:08 -07:00 |
|
|
|
92e9c6bf13
|
[ROCm] Fix misrouting race-condition in multi-decode P/D disagg with mori-io (#51681)
Signed-off-by: Vincent Cave <vincent.cave@amd.com>
Signed-off-by: Shiksha Patel <shikpate@amd.com>
Co-authored-by: Shiksha Patel <shikpate@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-24 19:52:43 +00:00 |
|
|
|
90a9515006
|
[Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-24 12:48:14 -07:00 |
|
|
Misha Goin
|
58aa2f1ef1
|
[Refactor] Move auxiliary files out of the repository root (#58572)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-24 12:38:56 -07:00 |
|
|
Misha Goin
|
cd06e81c41
|
[Bugfix][Quantization] Add Humming to the W4A8 (INT4xFP8) MoE oracle (#58427)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-24 12:37:33 -07:00 |
|
|
Xun Sun
|
e773247f8a
|
[Fast Start] Wait for weight cache daemon readiness (#58370)
|
2026-09-24 19:18:04 +00:00 |
|
|
Nick HillandKimi Code
|
e30559b58f
|
[Core] Skip JIT monitor when JIT warmup is disabled (#58590)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
|
2026-09-24 12:08:16 -07:00 |
|
|
Nick HillandKimi
|
074d57fce1
|
[Bugfix] Keep JIT warmup under enforce-eager when fault tolerance is on (#58593)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
|
2026-09-24 12:07:32 -07:00 |
|
|
|
5b3f280a6d
|
[Bugfix] Count unsplit Idefics3 image patches (#48760)
Signed-off-by: nightcityblade <nightcityblade@gmail.com>
Co-authored-by: nightcityblade <nightcityblade@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-24 11:36:26 -07:00 |
|
|
Thomas OrtnerandHarry Mellor
|
8b84e15066
|
[transformer] RMSNorm matching for alternative rsqrt (#54461)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-24 16:33:06 +00:00 |
|
|
Nick Hill
|
09fe178dba
|
Revert "[DSpark] Support pipeline-parallel targets in aggregated serving (#56956)" (#58484)
|
2026-09-24 08:48:36 -07:00 |
|
|
Harry MellorandClaude Opus 5.5
|
d636456b1f
|
[Frontend] Remove the slow tokenizer mode (#58545)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-24 08:48:28 -07:00 |
|
|
|
344fcc252a
|
[Bugfix] Resolve the Hub revision once per repo (#56092)
Signed-off-by: Wauplin <lucainp@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-24 08:48:24 -07:00 |
|
|
|
a7d203efe5
|
fix(config): apply presence_penalty/frequency_penalty from override-generation-config (#50769)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Signed-off-by: hclsys <chenglunhu@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-24 08:48:18 -07:00 |
|
|
Yueh-Ting (eop) Chen
|
26f49e336a
|
[Perf][Attention] Bound FlashInfer prefill dequantization scratch (#57918)
Signed-off-by: Yueh-Ting Chen <yueh.ting.chen@gmail.com>
|
2026-09-24 10:42:08 -04:00 |
|
|
Wentao Ye
|
3c42385d7d
|
[Refactor] Remove dead or duplicate tests (#58446)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-24 10:29:56 -04:00 |
|
|
Harry MellorandClaude Opus 5.5
|
d881812500
|
[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-24 14:14:10 +00:00 |
|
|
Linze Shi
|
484c211fe8
|
[Bugfix][Pooling] Fix JinaVL label configuration and restore multimodal tests (#57347)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-09-24 13:51:25 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
cccf7e1376
|
Remove .gemini/ and CLAUDE.md (#58541)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-24 12:57:23 +00:00 |
|
|
Fangzhou AiandClaude Opus 5.5
|
721d0e5c11
|
[ROCm][DSv4.1][Perf] Emit MXFP8 from the sparse decode reduce and run wo_a as a grouped FP8 GEMM (#58456)
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-24 11:58:14 +00:00 |
|
|
liuzhenwei
|
dcfc17e0b1
|
[XPU] enable XPU GRAPH by default (#51600)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-09-24 19:17:25 +08:00 |
|
|
Zijing Liu
|
f5a78f2ad7
|
[Multimodal] Reuse the supplied tokenizer in the MiniMax-M3 VL processor (#58460)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
|
2026-09-24 10:47:50 +00:00 |
|
|
SHREY GAJJAR
|
5747d4500a
|
[Perf][Frontend] Offload streaming derender detokenization (#57528)
Signed-off-by: Shrey Gajjar <shreygajjar007@gmail.com>
|
2026-09-24 10:39:21 +00:00 |
|
|
|
f34a0e0797
|
[CPU] Gate the AVX10.2 paths on compiler support (#58133)
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-24 18:07:53 +08:00 |
|
|
Ziyang Ma
|
cfd5c20286
|
[XPU][UT] Align HF and vLLM inputs for Qwen2 embedding test by preventing Sentence Transformers from applying chat template (#58117)
Signed-off-by: RyanMa29 <ziyang.ma@intel.com>
|
2026-09-24 10:07:37 +00:00 |
|
|
|
e430f7421f
|
[Bugfix][Rust Frontend] Prevent MM timing from enabling debug tracing (#58378)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-24 09:22:23 +00:00 |
|
|
Taneem Ibrahim
|
bbd7c24d6e
|
[MRV2] Validate MRV2 entrypoint logits processors (#57728)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-24 09:07:26 +00:00 |
|
|
|
5963795ec7
|
[Attention][CPU] Run Zen CPU encoder attention on zentorch SDPA (#54508)
Signed-off-by: priyansh jain <priyansh.jain2@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-24 02:05:44 -07:00 |
|
|
Yejing LaiandKunshang Ji
|
14f98cbe5d
|
[Bugfix][XPU] store the pointer raw bit pattern instead of its numeric value (#54514)
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-24 02:05:26 -07:00 |
|
|
|
c0c35ddd8e
|
[Bugfix][CI] Fix the flaky sharded-sampling tests, and the engine teardown need (#58342)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-24 02:05:11 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
23110a0c9e
|
[Bugfix] Capture prefill kernels for mixed FULL graphs (#58275)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-24 02:05:07 -07:00 |
|
|
jackLeiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
bbc4ddeca9
|
[Bugfix][V1] Reject encoder-cache hits with mismatched embedding counts (#57696)
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-24 08:40:47 +00:00 |
|
|
Li, Jiang
|
b44895cf93
|
[CPU] Use pre-built triton (#58140)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-09-24 16:12:34 +08:00 |
|
|
Talor Abramovich
|
28282ffe34
|
[Feature][Frontend] Request JSON body debug logging on --enable-log-requests flag (#58163)
Signed-off-by: talora <talora@nvidia.com>
|
2026-09-24 08:08:40 +00:00 |
|
|
Thien TranandOpenAI Codex
|
00b7847c80
|
[Perf] Use Conv3dLayer for MiniMax M3 patch embedding (#58512)
Signed-off-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-24 00:41:36 -07:00 |
|
|
|
1291bdb85e
|
[EPD][Model Loader] Skip language-model checkpoint shards for --mm-encoder-only (#58086)
Signed-off-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-24 00:41:15 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
c3f5270270
|
[ROCm][CI] Add the MI355 TurboQuant t3nc mirror (#58432)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-24 02:16:09 -05:00 |
|
|
|
67ddac3ea8
|
[CPU][GDN] Support NIXL DS convolution-state layout (#53300)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-09-24 14:55:20 +08:00 |
|
|
Andreas KaratzasandCodex
|
153f2ba1b9
|
[Compile][CI] Honor Triton cache overrides and add AMD timeout headroom (#58474)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-24 01:27:07 -05:00 |
|
|
|
e028554a1f
|
[Rust Frontend] Support --sse-keep-alive-interval (#58306)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-24 06:19:14 +00:00 |
|