Commit Graph
20961 Commits
Author SHA1 Message Date
Kevin H. LuuandCodex 537af2c3a4 [CI] Recover empty multi-node Docker networks and finish partial cleanup (#55454)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-07 12:53:13 -07:00
Kevin H. LuuandCodex 58f09211dd [CI] Synchronize shared offload unlink test before observing pathname (#55604)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-07 12:52:36 -07:00
Sahil Patel 51da0ca66c [CI/Build] Unskip ColQwen3 multimodal pooling tests on Transformers v5 (#55588)
Signed-off-by: Sahil <sip4818@gmail.com>
2026-09-07 15:15:39 +00:00
Zeyu Yang ad2f18e8af [CI] reduce npu CI use time and add timeout (#55731)
Signed-off-by: yangzeyu <yangzeyu7@huawei.com>
2026-09-07 22:51:09 +08:00
am-cohereCursormergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
70584f69b1 [Model] Add Cohere Compass model (#54774)
Signed-off-by: am-cohere <312513976+am-cohere@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-07 07:36:49 -07:00
AbhiandAntigravity 7cc89a7dda [Tests] Update SarvamMLA transformers v5 compatibility reason to hf (#55728)
Signed-off-by: Abhi <108084481+Aj2280@users.noreply.github.com>
Co-authored-by: Antigravity <antigravity@google.com>
2026-09-07 14:27:07 +00:00
Nicolò Lucchesi cd64c2dea9 [Docs] Clarify admission control limits apply server-wide, not per DP rank (#55124)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
2026-09-07 14:08:48 +00:00
f2d45f26bd [Bugfix][Gemma] Conditionally create KV projections/norms on KV-shared layers (#54917)
Signed-off-by: Josephasafg <ajgard7@gmail.com>
Co-authored-by: minyichen <96753147+cyc00518@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
2026-09-07 15:04:00 +01:00
Roberto L. CastroCodexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
42801b3a6b [3/N][warmup][DSv4] Migrate FA4 MLA and shared CuTeDSL kernels (#53565)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-07 09:36:35 -04:00
Roberto L. CastroCodexOpenAI CodexLucas Wilkinsonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
1713b9866a [2/N][warmup][DSv4] Migrate sequence and DCP kernels (#53564)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-07 09:35:54 -04:00
Taneem Ibrahim ecd600d91e [Pooling] Honor max_embed_len for chunked embeddings (#55551)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-09-07 09:31:40 -04:00
Adababyandshaolila 167858ea17 [Frontend] Migrate Responses harmony input validation to VLLMValidationError (#55701)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
2026-09-07 13:30:11 +00:00
Soumyajit GhoshSOUMYAJIT GHOSHmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b339d75a41 [Bugfix][Spec Decode] Resolve n_predict from text_config for Qwen3.5 multimodal MTP (#55369)
Signed-off-by: SOUMYAJIT GHOSH <23051387@kiit.ac.in>
Signed-off-by: Soumyajit Ghosh <jobsoumyajit6124@gmail.com>
Co-authored-by: SOUMYAJIT GHOSH <23051387@kiit.ac.in>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-07 13:28:26 +00:00
Francisco Javier ArceoandOpenAI Codex 6a2a2bb02b [Frontend] Add stateless /v1/responses/render endpoint (#50195)
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-07 12:50:42 +00:00
Artur Fierka 5e6f6a8ed4 [Bugfix][Quantization][XPU] Fix moe_wna16 linear weight loading (#52651)
Signed-off-by: Artur Fierka <artur.fierka@intel.com>
2026-09-07 20:20:17 +08:00
Kam BasraandClaude 4a806d08ee [Bugfix] OffloadingConnector: stop zeroing offload hits under MTP/EAGLE spec decode (#52771)
Signed-off-by: Kam Basra <kameldipbasra@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-07 15:16:05 +03:00
Thien Tran 94e26dd3dd [Qwen3.8-Flash-Next] Support FP8 indexer cache for QSA (#54890)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-09-07 12:15:45 +00:00
Sean Westfall 58ad1f3b89 [Docs] Add OLMo 2 to batch-invariance tested models (#55691)
Signed-off-by: Sean Westfall <sean.westfall@gmail.com>
2026-09-07 09:56:49 +00:00
Chaojun Zhang 8648446515 [XPU][LoRA] Support LoRA for DeepSeek V4 on XPU (#53689)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
2026-09-07 17:44:12 +08:00
Marceli FylcekandClaude Opus 5 9b85112e13 [XPU] Route grouped_topk to the fused _moe_C kernel on XPU (#53580)
Signed-off-by: Marceli Fylcek <marceli.fylcek@intel.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-07 17:43:38 +08:00
Adababyandshaolila 7dbe386833 [Frontend] Migrate Responses API validation errors to VLLMValidationError (#50257)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
2026-09-07 17:33:51 +08:00
Andreas KaratzasandOpenAI Codex e476556189 [ROCm][CI] Add attention-sink support to ROCm AITER sparse MLA (#54404)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-07 09:26:47 +00:00
Chaojun Zhang 392db567b2 [CI] [Test] skip test_wna16_cuda_high_bit_skips_humming on non-CUDA platforms (#55660)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
2026-09-07 16:57:15 +08:00
AlexHuang 49eb2accf0 [KVConnector] Guard lmcache_mp_connector state transition with num_external_tokens (#47505)
Signed-off-by: Alex <alex.tech.lab@outlook.com>
Signed-off-by: Alex-ai-future <Alex-ai-future@users.noreply.github.com>
2026-09-07 08:19:07 +00:00
Gabriel Wumergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Jee Jee LiYongye Zhu
5893426b88 [Bugfix] DSv4 MXFP4 selector: stop narrowing explicit aliases to their BF16 variant (#53586)
Signed-off-by: Zihua Wu <zihuaw@nvidia.com>
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
2026-09-07 07:19:13 +00:00
Zhewen Liandzhewenl 34b1e9f7a6 [Bugfix][MooncakeStore] Fix finish-time save crash on hybrid models (#54643)
Signed-off-by: zhewenl <zhewenl@users.noreply.github.com>
Co-authored-by: zhewenl <zhewenl@users.noreply.github.com>
2026-09-07 07:18:30 +00:00
Andreas Karatzas 195bc9c4a1 [CI][ROCm] Temporarily skip unsupported HY-V4 initialization (#55653)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-09-07 15:17:36 +08:00
6fbb00b188 [EPD] Add ECMooncakeConnector for encoder cache over Mooncake TransferEngine (#41567)
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-07 06:21:43 +00:00
Andreas Karatzas f7f060d253 [Bugfix][Audio] Restore soundfile-first automatic decoding (#55642)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-09-07 06:21:02 +00:00
zofiaandKunshang Ji ed29dfae6e [XPU] Use fused_input_norm kernel in FusedInputNorm (#52945)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-09-07 13:44:31 +08:00
Thien Tran d9105ea800 [Qwen3.8-Flash-Next] Remove torch.compile for NVIDIA implementation (#55272)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-09-06 21:57:56 -07:00
frankieandTrae Agent 9cc7793e32 [Bugfix] Gracefully handle unsupported reasoning_effort in chat templates (#54022)
Signed-off-by: frankie <wangyongsheng686@gmail.com>
Co-authored-by: Trae Agent <noreply@trae.ai>
2026-09-06 21:11:35 -07:00
Jiangyun Zhu f43ef1531d [CI] fix pre-commit (#55630)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
2026-09-06 20:54:22 -07:00
vhagorandIsotr0py 3dc7a68ce4 [Perf] Extend Qwen Triton warmup to avoid first-request latency spikes (#54797)
Signed-off-by: Juqi Li <2223621784@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-09-07 11:46:00 +08:00
Wei Zhao 6748217fb9 [Bugfix] Fix Kimi K3 NVFP4 MoE weight conversion OOM (#55407)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
2026-09-07 11:45:25 +08:00
Wei Zhao c3ec0d29f5 [Bugfix] Fix cuda profiler missing bug (#55237) 2026-09-07 03:15:57 +00:00
yulunandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 1f778486fc [Bugfix][Offloader] Preserve prefetch static-buffer slot ownership (#54975)
Signed-off-by: Big2Wheel <1404207590@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-07 10:58:44 +08:00
de69e821b7 [ROCm][Perf][DeepSeek V4] Fuse native FP8 shared expert with MXFP4 routed experts (#53161)
Signed-off-by: fai <fangzhouai@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Cursor Agent <agent@cursor.com>
2026-09-06 19:42:21 -07:00
Wenhua Cheng 294fbb4f59 add 2/3/5/6/7 CUDA support in AutoRound format (#52890)
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
2026-09-07 09:59:19 +08:00
Jee Jee Li 199cb9b964 [Kernel] Remove unused fake implementation (#55535)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-09-06 17:54:32 -07:00
Jürgen Schmied 4df80187b5 [Kernel] SM 12.x blockwise FP8: swizzle the CTA raster when the weight exceeds the L2 (#55180) 2026-09-06 17:36:59 -07:00
Kevin H. LuuandCodex 6865e67f0b [Bugfix] Defer adaptive verification until after kernel warmup (#55455)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-06 11:31:40 -07:00
Kevin H. LuuandCodex 722d169339 [CI] Align extraction test with canonical auxiliary layer order (#55457)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-06 11:22:14 -07:00
zhouyouandCursor Grok 4.6 52358e6e19 [Frontend] Expose multimodal metadata for disaggregated prefill (#54659)
Signed-off-by: zhouyou9505 <zhouyou9505@gmail.com>
Co-authored-by: Cursor Grok 4.6 <noreply@cursor.com>
2026-09-06 14:46:52 +00:00
aoshen02andCodex 808f8cd3ac [Governance] Add aoshen02 as code owner for RL components (#55529)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
2026-09-06 13:26:22 +00:00
Almog TavorandOr Ozeri dc02934a07 [Bugfix][KV Offload] Stop offloading the final sampled token's KV slot (#54288)
Signed-off-by: almogtavor <almogtavor@gmail.com>
Signed-off-by: Almog Tavor <70065337+almogtavor@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
2026-09-06 15:22:19 +03:00
569adb5a97 [Bugfix][KV Offload] Fix SWA store reachability during chunked prefill (#54362)
Signed-off-by: Will Hampson <whamp@ggl.slmail.me>
Co-authored-by: Will Hampson <whamp@ggl.slmail.me>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-06 13:50:39 +03:00
Zupeng WangandCodex dd0760165c [Bugfix] Fall back to T1 when ARC cannot reclaim enough entries from T2 (#55461)
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-06 13:28:19 +03:00
9afb878a55 [Bugfix][KV Offload] Skip cleaned-up async lookup batches (#55075)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-09-06 13:27:46 +03:00
SunandIsotr0py a1541f5742 [Perf] Use SDPA for BLIP-2 Q-Former attention (#55285)
Signed-off-by: levius <2114377220@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-09-06 07:04:19 +00:00