 Bugen ZhaoandOpenAI Codex
|
08b73d07cc
|
[Frontend] Prevent Kimi K3 reserved markers in response text (#52889)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 09:06:52 -07:00 |
|
|
Russell Bryant
|
6d8cd88e8d
|
[Docs] document cache salting for prefix cache timing side-channel mitigation (#39082)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2026-08-21 09:06:49 -07:00 |
|
|
Lee Yongjunandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
6f74337c47
|
[Bugfix][Spec Decode]Preserve user --speculative-config overrides for speculators-format models (#42376)
Signed-off-by: leeyongjun <jqueen.astro@gmail.com>
Signed-off-by: Lee Yongjun <35302114+elwhyjay@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-08-21 09:06:47 -07:00 |
|
|
yimdevandusberkeley
|
574e6a00ef
|
[Bugfix][Attention] Normalize FlashInfer prefill LSE before merging (#52796)
Signed-off-by: yimdev <5779256+yimdev@users.noreply.github.com>
Co-authored-by: usberkeley <150880684+usberkeley@users.noreply.github.com>
|
2026-08-21 11:31:14 -04:00 |
|
|
Luke Alonsoandmgoin
|
2740c817ff
|
[Kernel] Add b12x FP4 MoE backend (#52018)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-08-21 08:04:36 -07:00 |
|
|
Frederik GossenandClaude
|
5ee84d3c52
|
[CI][Bugfix] Use a prompt that survives offload-resume rounding in mamba offload test (#53146)
Signed-off-by: Frederik Gossen <frgossen@meta.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-21 10:14:52 -04:00 |
|
|
shijuzhaoandshijuzhao
|
cda3868f5d
|
[Bugfix] Deterministic MoE combine (reduce_scatterv) under VLLM_BATCH_INVARIANT (#45683)
Signed-off-by: shijuzhao <shijuzhao@tencent.com>
Co-authored-by: shijuzhao <shijuzhao@tencent.com>
|
2026-08-21 21:41:31 +08:00 |
|
|
Harish Gaikwad
|
c8438a3d40
|
[Doc] Fix dead link in KV transfer README (#53230)
Signed-off-by: hagaikwa-redhat <hagaikwa@redhat.com>
|
2026-08-21 12:03:41 +00:00 |
|
|
Shuai ShaoandJee Jee Li
|
a60c66e3dc
|
[Bugfix] Fix int32 index overflow in LoRA punica kernels at long context (#53034)
Signed-off-by: Shuai Shao <ss@rungalileo.io>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-21 10:37:06 +00:00 |
|
|
Yan Ma
|
6feafb8b7d
|
[XPU] follow cuda path for mrope on XPU (#53201)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-08-21 10:13:27 +00:00 |
|
|
linitra24
|
e85d1b69cf
|
[Bugfix][LoRA] Use an explicit capability flag for tower connector LoRA (#53092)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-21 09:45:54 +00:00 |
|
|
xiangdongandKunshang Ji
|
36bad1b90c
|
[XPU][CI]Add more cases in intel GPU CI and reorganize to align non-xpu part (#51630)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-21 09:31:25 +00:00 |
|
|
xiangdong
|
0a21947d71
|
[XPU][CI]Add parallelism for long-running Intel GPU cases (#52257)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-08-21 16:02:34 +08:00 |
|
|
Thanaji Rao ThakkalapelliandKunshang Ji
|
9fd750f00d
|
[XPU][INC] Add int4 w4a8 (dynamic int8 activation) backend for INC linear layers (#50501)
Signed-off-by: Thanaji Rao Thakkalapelli <thanaji.rao.thakkalapelli@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-21 14:38:59 +08:00 |
|
|
Wei ZhaoandOpenAI Codex
|
f8e0602713
|
Support kimi k3 nvfp4 checkpoint (#53132)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-21 05:59:44 +00:00 |
|
|
Zihan Zhang
|
b389ac2946
|
[Spec Decode] DFlash2: local convolution + candidate selector (#52816)
|
2026-08-20 22:27:22 -07:00 |
|
|
Roy Wang
|
df344bf36f
|
[Rust][Benchmark] Load HF datasets from parquet shards via hf-hub, fixing truncated-cache sampling (#51570)
|
2026-08-21 05:07:43 +00:00 |
|
|
vhagor
|
ba07e4a48f
|
[Bugfix] Fix batch-invariant fp32 matmul OOR on SM89 for N=1 (#52960)
Signed-off-by: Juqi Li <2223621784@qq.com>
|
2026-08-21 11:46:55 +08:00 |
|
|
|
2785c72a14
|
[Kimi-K3] Extend GEMM-RS to GEMM-AR (#53053)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-21 03:44:15 +00:00 |
|
|
Cyrus Leung
|
b00f475f09
|
[MM] Remove text components from ProcessorInputs (#53093)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-20 20:42:53 -07:00 |
|
|
ReidandBugen Zhao
|
2adf4b9e2a
|
[Rust Frontend] Fix Kimi K3 reasoning_effort="none" handling (#53043)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-08-21 02:47:07 +00:00 |
|
|
Lucas WilkinsonandOpenAI Codex
|
5df31ea52d
|
[Spec Decode] Enable adaptive verification on DSv4 + sm90 (#52795)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-20 22:44:55 -04:00 |
|
|
Bugen Zhao
|
df3b3422b4
|
[Rust Frontend] Add HY3 unified parser and local XGrammar structural-tag builder (#53054)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-20 19:13:54 -07:00 |
|
|
Chauncey
|
c6e19b3be2
|
[Bugfix][Structured Output] Avoid spurious FSM errors after speculative reasoning end (#53046)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-21 10:01:06 +08:00 |
|
|
|
83c5d59209
|
[Rust Frontend] Replace external protoc with pure Rust lib protox (#52892)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-20 18:43:51 -07:00 |
|
|
|
91a893de64
|
[Bugfix][Spec Decode] Scope DSpark backend inheritance to DeepSeek V4 (#52809)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-20 18:42:08 -07:00 |
|
|
Kevin H. Luu
|
d29f7f5c92
|
[Bugfix] Load untied Gemma LM head weights (#53170)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-21 00:47:08 +00:00 |
|
|
Bugen Zhao
|
f32b17b6d6
|
[Rust Frontend] Support --generation-config vllm (#53044)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-20 17:31:25 -07:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
0a5a55136f
|
[CI][Docker] Pin remaining manylinux builder images (#53172)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-20 23:17:02 +00:00 |
|
|
|
7cfb97e337
|
[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)
Signed-off-by: Matthew Kotila <7692737+matthewkotila@users.noreply.github.com>
Co-authored-by: Reed Meyerson <31574681+reed-meyerson@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-20 15:42:49 -07:00 |
|
|
MKQuantum
|
2f41c894e3
|
Fix seed loss when batch contains unseeded requests (#51866)
Signed-off-by: MKQuantum <121593006+MKQuantum@users.noreply.github.com>
|
2026-08-20 22:38:53 +00:00 |
|
|
Andrey Talman
|
54ba80d961
|
[CI][Docker] Pin manylinux2_28-builder:cuda13.0 to the release/2.13 image (#52994)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-08-20 15:19:40 -07:00 |
|
|
Misha GoinandOpenAI Codex
|
bfb6c13499
|
[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-20 16:26:24 -04:00 |
|
|
Canlin Guo
|
4f6885fffc
|
[DSV4][Kernel] Fuse shared experts into MegaMoE (#53040)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-20 12:07:02 -07:00 |
|
|
stefankoncarevic
|
3b829cf176
|
[CI/Build][ROCm] Keep the CUDA-only kernel tests out of the ROCm run (#53113)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-20 13:40:33 -05:00 |
|
|
Thanh Phan
|
d56bbf3995
|
[Bugfix] Support MistralCommonBackend tokenizers in structured output (#52720)
Signed-off-by: Thanh Phan <thanhphantuan1110@gmail.com>
|
2026-08-20 19:08:50 +01:00 |
|
|
kyleliang-nv
|
7c8b68b9ce
|
[Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)
Signed-off-by: Kyle Liang <kylliang@nvidia.com>
|
2026-08-20 10:45:28 -07:00 |
|
|
Isotr0py
|
00f7f25828
|
[Misc] Don't allow language-model-only used with encoder CG together (#53127)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-20 17:26:47 +00:00 |
|
|
Dennis Yeh
|
ae25628995
|
upgrade tpu-inference to v0.27.0 (#53088)
|
2026-08-20 16:21:39 +00:00 |
|
|
Harry Mellor
|
1fe3a1571a
|
Reduce AutoWeightsLoader kwargs (#53106)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 15:40:11 +00:00 |
|
|
Harry Mellor
|
2dd17225c6
|
Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 15:21:23 +00:00 |
|
|
|
01af92e175
|
[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-20 11:13:43 -04:00 |
|
|
Yiqinandshenyiqin
|
cb09dd7488
|
[Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)
Co-authored-by: shenyiqin <shenyiqin1@huawei.com>
|
2026-08-20 15:04:29 +00:00 |
|
|
SeonjinandMisha Goin
|
bd8865a299
|
[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)
Signed-off-by: seonjinn <sna@nvidia.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-08-20 10:07:22 -04:00 |
|
|
Prudhvi Vuda
|
de216b6e64
|
[Bugfix] Skip MM processor cache inserts larger than capacity (#53016)
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
|
2026-08-20 13:42:50 +00:00 |
|
|
Sandeep MaddipatlaandKunshang Ji
|
4b7cb949a9
|
[Docker] Update to nixl-1.3.2 (#51777)
Signed-off-by: Sandeep Maddipatla <sandeep.maddipatla@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-20 21:03:32 +08:00 |
|
|
Zupeng Wang
|
df1376907b
|
[Model] Add tower and connector LoRA support for LFM2-VL (#51498)
Signed-off-by: zupengwang <71580390+zupengwang@users.noreply.github.com>
|
2026-08-20 20:33:43 +08:00 |
|
|
Thien TranandOpenAI Codex
|
6259572b28
|
[Docs] Use incremental builds for C++ changes in AGENTS.md (#53098)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-20 04:08:50 -07:00 |
|
|
Kevin H. Luu
|
6df7adc17f
|
[Bugfix][GDN] Reset speculative decode count for an empty draft schedule (#53077)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-20 10:33:41 +00:00 |
|
|
Harry Mellor
|
f0c14b4f77
|
Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 10:31:55 +00:00 |
|