 Ziming Huang
|
beca88e59e
|
[BugFix][K3] Skip moe_intermediate padding when EP is enabled (#51131)
|
2026-08-05 09:22:55 +00:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
a3b86752fb
|
[CI] Fix CI authorization notification fallback (#51095)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-05 01:34:48 -07:00 |
|
|
SageandBugen Zhao
|
5bf32605a9
|
[Rust Frontend] Deduplicate request preprocessing for /tokenize (#50448)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-05 08:27:35 +00:00 |
|
|
|
fd859d2e06
|
[KV Connector][Mooncake] Add store group semantics (#44956)
Signed-off-by: Schatten <czhengt@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-05 08:25:38 +00:00 |
|
|
kliuae
|
f5cd862dbd
|
[ROCm][Bugfix] Kimi-K3 Fix KDA NaN on mixed batches and racy autotune config (#50649)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
|
2026-08-05 08:07:21 +00:00 |
|
|
MINJUN GIL
|
b92352ca2c
|
[Perf][KV Offload] Avoid quadratic ARC batch eviction (#50992)
Signed-off-by: MINJUN GIL <alswnsrlf12@naver.com>
|
2026-08-05 10:58:36 +03:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
96e333e81a
|
[CI] Run control-plane workflows on vLLM runners (#51127)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-05 00:14:27 -07:00 |
|
|
Sundaresan GandKunshang Ji
|
999dd8b490
|
[XPU] Alias is_current_stream_capturing to XPU in cuda wrapper (#50526)
Signed-off-by: Sundaresan-G <sundaresan.g@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-05 15:10:17 +08:00 |
|
|
qizixiandClaude Opus 5
|
4719a9b8f5
|
[Bugfix][Spec Decode] Fix EAGLE3 DeepSeek draft crash on non-YaRN rope configs (#51092)
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 14:10:52 +08:00 |
|
|
Tianyu Guo
|
50c51682a1
|
[Bugfix][EC Connector] Don't stop an encoder-instance request before its images are encoded (#50275)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-08-05 05:53:58 +00:00 |
|
|
Wei-Cheng (Wayne) ChiuandOpenAI Codex
|
7794b1e08b
|
[Bugfix] Skip Qwen3 deepstack buffers without vision (#49397)
Signed-off-by: WEI CHENG CHIU <waynehacking8@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-05 12:46:23 +08:00 |
|
|
TrainToGPBandClaude
|
eb3dce9757
|
[Bugfix][Model] Gemma3n/Gemma4: pad variable-length audio batches (#50958)
Signed-off-by: TrainToGPB <kaiba0514@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-05 12:46:00 +08:00 |
|
|
|
c25093a305
|
[Kernel] Batch invariant NVFP4 MoE using cutlass (#40372)
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-05 04:31:32 +00:00 |
|
|
|
41a7e7da0c
|
[KV Offload] Support partial secondary-tier load results (#50321)
Signed-off-by: Moein Khazraee <moein@nvidia.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-08-04 20:48:58 -07:00 |
|
|
aoshen02andyihengz
|
6153dbe036
|
[R3] Unify routed expert shape configuration (#50940)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: yihengz <yihengz@nvidia.com>
|
2026-08-04 20:20:41 -07:00 |
|
|
Rehan KhanandLi, Jiang <jiang1.li@intel.com>
|
0187f4c88e
|
[CPU] Enable tcmalloc for s390x (#50841)
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-05 10:55:39 +08:00 |
|
|
Yejing Laiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2cb3ff88cc
|
[BUGFIX][Quant]Fix test_kv_scale_reload failed (#50405)
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-05 10:50:54 +08:00 |
|
|
Dr Tasos VaroudisandLucas Wilkinson
|
c416f15710
|
[Model] Fix Kimi-K3 MLA with disabled context parallelism (#50404)
Signed-off-by: Tasos Varoudis <varoudis@archtech.gr>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-08-05 02:33:14 +00:00 |
|
|
Divakar Verma
|
bb543efdfd
|
[ROCm][CI] Add aiter per-token FP8 quant roundtrip and RMSNorm determinism tests (#50905)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-08-04 21:32:08 -05:00 |
|
|
Michael Goin
|
9cd9f8c20b
|
Prune redundant tests points in correctness_e2e/[test_sequence_parallel,test_async_tp] (#51068)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-04 19:18:50 -07:00 |
|
|
Andreas Karatzas
|
33c50587d2
|
[ROCm] Restore Inkling MTP backend parity (#50806)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-05 02:02:57 +00:00 |
|
|
Michael Goin
|
d16e7f9da4
|
[CI] Prune PyTorch Compilation Unit Tests (#51069)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-05 09:53:50 +08:00 |
|
|
Nick Hill
|
77b519912b
|
[CI][Bugfix] Fix test_shutdown_on_engine_failure startup deadlock (#51050)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-04 20:29:35 -05:00 |
|
|
Rohan PotdarandClaude Opus 4.8
|
d0ce3dadb6
|
[ROCm]: Bump torch 2.12, triton 3.7, torchaudio, torchvision (#50607)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-04 20:14:11 -05:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
43c4bdcae9
|
[CI] Add run-all comment commands (#51087)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-08-04 17:34:27 -07:00 |
|
|
Yifan Qiaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ffee32460d
|
[BugFix][Mooncake] Use global data_parallel_index for the DP engine index (#48061)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 17:10:51 -07:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
12292d94b2
|
[CI] Detect and fail evals on when NaNs appear in logits (#50323)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 23:02:58 +00:00 |
|
|
xiaozhoupyandClaude
|
3756bf1e2b
|
[Kernel][SM100] Add a CuTeDSL fused query kernel (#49792)
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-04 15:23:06 -07:00 |
|
|
Kevin H. Luu
|
c687c1abb8
|
[ci] Update CI notify workflow with PR write permissions (#51079)
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-08-04 14:15:27 -07:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
a5149b2fee
|
[CI] Stabilize GLM-5.2 PCP evaluation (#51015)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 14:13:59 -07:00 |
|
|
|
05b7876f50
|
[MoE][Humming] Support SiTU activation for Kimi-K3 (#50510)
Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-08-04 12:39:18 -07:00 |
|
|
Canlin Guo
|
edbc4969a7
|
[Kernel][Inkling] Fuse shared-expert partial addition into the Lamport collective (#50697)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-08-04 18:41:35 +00:00 |
|
|
NVShreyasandOpenAI Codex
|
8ae8337ffa
|
[Spec Decode] Enable fused non-causal TokenSpeed MLA for DSpark (#50911)
Signed-off-by: Shreyas Misra <shreyasm@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 18:05:40 +00:00 |
|
|
Wentao Ye
|
d31de3c421
|
[Kimi K3 Perf] option to shard the shared expert for non mega case, 16.98 GiB memory/GPU saved (#50912)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-04 14:00:44 -04:00 |
|
|
Linkunandlkchen
|
7cab4368f2
|
[MM][CG] Support ViT full CUDA graph for Kimi-K2.5 (#50929)
Signed-off-by: lkchen <anthropic@lkchen.net>
Co-authored-by: lkchen <anthropic@lkchen.net>
|
2026-08-04 17:15:56 +00:00 |
|
|
Nick HillandClaude
|
7635a9002b
|
[Core] Explicitly manage torch CPU threads in workers (#49919)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-04 10:06:38 -07:00 |
|
|
amitz-nvandOpenAI Codex
|
52c0e3cb08
|
[Kernel] Add support for Flashinfer Mamba SSU algorithm selection (#50157)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-04 09:40:23 -07:00 |
|
|
|
7ac2ec7582
|
[Kimi-K3][AMD] Fuse AttnRes state updates and norms (#50593)
Signed-off-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 12:32:13 -04:00 |
|
|
aoshen02andaoshen02
|
7153fd70f6
|
[Bugfix][MoE] Filter packed expert weights during EP loading (#49558)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-08-04 16:32:03 +00:00 |
|
|
|
166f4e2dc3
|
fix: fuse weightless RMSNorms at their declared width (#50867)
Signed-off-by: Anuj Bolewar <anujbolewar@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Anuj Bolewar <anujbolewar@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-04 16:03:09 +00:00 |
|
|
Wentao Ye
|
4f819f801b
|
[Model Runner v2] E/P/D disaggregation support (#38390)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-08-04 15:52:23 +00:00 |
|
|
Bugen Zhao
|
7743486190
|
[Frontend] DeepSeek V4 0731 reasoning effort prompts & mappings (#50580)
|
2026-08-04 08:51:32 -07:00 |
|
|
Jiangyun Zhuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f9c74b4b9c
|
[Mamba] enable prefix cache by default (#50991)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 15:20:51 +00:00 |
|
|
Nicolò Lucchesi
|
7b50d2c0bc
|
[Misc] Avoid importing nixl_ep on every vllm serve config (#50879)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-04 07:56:54 -07:00 |
|
|
Harjoth Khara
|
122b3d46b6
|
[Bugfix][CPU] Fix macOS build: std::sqrt is not constexpr under libc++ (#50915)
Signed-off-by: harjoth <harjoth.khara@gmail.com>
|
2026-08-04 14:56:33 +00:00 |
|
|
|
199644d410
|
[Bugfix][Attention] Guard sparse MLA masked MHA workspace (#50906)
Signed-off-by: yimdev <5779256+yimdev@users.noreply.github.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-08-04 09:59:33 -04:00 |
|
|
Michał Ganczarenko
|
7c40d61eaf
|
[Bugfix] Flatten >2D multimodal embeddings, not just 3D (#50250)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
|
2026-08-04 13:34:58 +00:00 |
|
|
|
5f2ee2fa8c
|
[Bugfix][Core] Log KV cache capacity after block-size resolution (#50462)
Signed-off-by: Tanmay Dixit <22117787+tandixit95@users.noreply.github.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tanmay Dixit <22117787+tandixit95@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-04 12:53:32 +00:00 |
|
|
Andrii SkliarandAndrii Skliar
|
5789897aa4
|
[Spec Decode] Add top-k DSpark Markov projection (#49969)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
|
2026-08-04 12:52:53 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
1eb3694521
|
[Docs] Fix two docs build warnings (#51014)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-04 05:29:04 -07:00 |
|