 Kevin H. Luu
|
4bf06be985
|
[CI] Disable CUDA graphs for GLM PCP evals (#54745)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-09-01 20:24:46 +00:00 |
|
|
Isotr0py
|
dc5cf437cf
|
[Rust Frontend] Enable Qwen4-exp multimodal support (#54813)
|
2026-09-01 20:23:55 +00:00 |
|
|
Zhewen Liandzhewenl
|
5cc32fbdfa
|
[Bugfix][KV Connector] Fix Mooncake physical-block transfer length (#54272)
Signed-off-by: zhewenl <zhewenl@users.noreply.github.com>
Co-authored-by: zhewenl <zhewenl@users.noreply.github.com>
|
2026-09-01 13:23:46 -07:00 |
|
|
|
7cb9a88f50
|
[Bugfix][Mooncake] Offload producer partial tails on request finish (#52832)
Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-01 13:23:35 -07:00 |
|
|
Alberto MassiddaandAlberto Massidda
|
55178f2d09
|
[Bugfix][Profiler] Fix API server crash on double /stop_profile (#51678)
Signed-off-by: Alberto Massidda <amassidda@nvidia.com>
Co-authored-by: Alberto Massidda <amassidda@nvidia.com>
|
2026-09-01 13:05:04 -07:00 |
|
|
stefankoncarevic
|
73723b707f
|
[ROCm][MoE] Fix gfx950 block scale swizzle for AITER Triton MXFP4 W4A16 (#54773)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-09-01 19:48:45 +00:00 |
|
|
Bugen Zhao
|
3439bad37e
|
[Rust Frontend] Bound recursive argument parsers (#54303)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-01 12:45:50 -07:00 |
|
|
Julien Debache
|
ab54f5bd83
|
[Chore] Remove redundant _pack_topk_ids_weights_kernel in TrtLLM NvFP4 MoE (#46872)
Signed-off-by: jdebache <jdebache@nvidia.com>
|
2026-09-01 15:30:11 -04:00 |
|
|
Luyi XiaoandOpenAI Codex
|
aa71f9bcc4
|
[Bugfix] Log platform plugin detection failures (#52285)
Signed-off-by: Luyi Xiao <xiao.luy@northeastern.edu>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-01 19:11:52 +00:00 |
|
|
Divakar VermaandAndreas Karatzas
|
c0adee9231
|
[ROCm][CI] Add ROCm misc ops and env tests (#53279)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-01 19:03:37 +00:00 |
|
|
Wentao Ye
|
6c58595c2d
|
[Feature] Avoid flashinfer autotune each time when vllm source change (#54794)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-01 15:03:30 -04:00 |
|
|
waizuichougou
|
d98bb2a879
|
[Bugfix][Frontend] Honor skip_decoder_start_token in async encoder-decoder rendering (#54799)
Signed-off-by: waizuichougou <2082431897@qq.com>
|
2026-09-01 19:00:28 +00:00 |
|
|
Pratham ShirbhateandCyrus Leung
|
0ad5652a52
|
[Bugfix][Frontend] Restore the chat template content format mismatch warning (#54622)
Signed-off-by: Pratham Shirbhate <prathamshirbhate1909@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-01 18:17:54 +00:00 |
|
|
fxmarty-amdandAndreas Karatzas
|
d1c15e589d
|
[CI] Speed up quantization test group (#53291)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-01 13:15:24 -05:00 |
|
|
|
e7cf4730d6
|
[Bugfix] Drop incomplete tool-call markup in non-streaming to match streaming (#47562)
Signed-off-by: Suvrakamal Das <jyb2084.usa@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com>
|
2026-09-01 18:11:36 +00:00 |
|
|
Misha Goin
|
2f01039666
|
[Misc] Share Buildkite CI failure skill across agents (#54806)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-01 10:22:09 -07:00 |
|
|
周峥andGuanyi Chen
|
c866ba9d11
|
[KV Connector] Support heterogeneous TP sharing in Mooncake Store Connector (#53129)
Signed-off-by: Guanyi Chen <939416532@qq.com>
Signed-off-by: z-zanez <zhouzh93@mail2.sysu.edu.cn>
Signed-off-by: Zheng Zhou <zhouzh93@mail2.sysu.edu.cn>
Signed-off-by: zane <zhouzh93@mail2.sysu.edu.cn>
Co-authored-by: Guanyi Chen <939416532@qq.com>
|
2026-09-01 10:18:06 -07:00 |
|
|
|
2fe5cef35e
|
[Fix] Fix FSE compatibility detection for Quark-produced models (#54573)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-01 12:12:20 -05:00 |
|
|
|
514c7314a0
|
[Perf][Kernel] Initialize NVFP4 padding in quant kernel (#53568)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-01 09:49:07 -07:00 |
|
|
Eli Nabro Yeongmin OhandCodex
|
cdefd9d499
|
[Bugfix] Support Sentence Transformers 5.4+ serialized configs (#54533)
Signed-off-by: maireneu <maireneu@gmail.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-01 15:53:38 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
f1e5fdd7f2
|
[Transformers backend] Replace vocab embeddings in recursive_replace (#54760)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-01 15:35:24 +00:00 |
|
|
Misha GoinandOpenAI Codex
|
82b7d49a6e
|
[MoE] Generalize masked activation for padded layouts (#51217)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-01 11:34:13 -04:00 |
|
|
Bojiang Li
|
a232e29e9d
|
[Bugfix] Gate sm_100-only kernel tests on the capability family, not >= (#54306)
Signed-off-by: bojiang3 <bli314159@gmail.com>
|
2026-09-01 11:29:15 -04:00 |
|
|
Taneem Ibrahim
|
76f3249fbd
|
[Mypy] Fix typing for M models (#54262)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-01 11:26:00 -04:00 |
|
|
Taneem Ibrahim
|
d9eb4e344f
|
[Bugfix] Reject tokenless chat and audio streams (#54708)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-01 11:24:19 -04:00 |
|
|
Chauncey
|
339e16cbb6
|
[Bugfix] Support MCP SDK 2.x tool input schemas (#53870)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-01 11:02:39 -04:00 |
|
|
Luke AlonsoandLucas Wilkinson
|
0d4ad47981
|
[Kernel] Add B12X causal paged attention backend (#52017)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-09-01 10:42:02 -04:00 |
|
|
Andrii SkliarandAndrii Skliar
|
adebc41b7e
|
[Mamba] Add FlashInfer ReplaySSM backend (#52506)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Andrii Skliar <andreyws96@gmail.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
|
2026-09-01 10:26:43 -04:00 |
|
|
Ilya Markov
|
25efcfa788
|
[Attention] Enable adaptive verification for FLASHINFER_MLA_SPARSE_DSV4 (#52724)
Signed-off-by: Markov Ilya <markovilya197@gmail.com>
|
2026-09-01 13:43:28 +00:00 |
|
|
Jan Kwieciński
|
1f1f628859
|
[Feat][MM Hashing] include media_io_kwargs in multi-modal hashes (#54241)
Signed-off-by: Jan Kwiecinski <jkwiecinski@nvidia.com>
|
2026-09-01 13:17:01 +00:00 |
|
|
Priyansh Jain
|
55aa766dc8
|
[Bugfix][Model] Fix GraniteMoeHybrid per-expert quantized weight loading (#54052)
|
2026-09-01 12:38:53 +00:00 |
|
|
|
40824284bc
|
[Doc] Document FP8 GEMM kernel selection and Blackwell support (#49936)
Signed-off-by: harjoth <harjoth.khara@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-01 13:22:40 +01:00 |
|
|
Zheng Cai
|
191cecd51e
|
[Kernel][Qwen] Add Hopper LL-GEMM tuning table for Qwen4Exp (#54560)
Signed-off-by: Zheng Cai <8370601+zigzagcai@users.noreply.github.com>
|
2026-09-01 11:21:41 +00:00 |
|
|
Ziming HuangandOpenAI Codex
|
481839ad9e
|
[Feature][Spec] Support disabling trailing prefix-cache block dropping (#53388)
Signed-off-by: Ziming Huang <zelda.huanghuang@gmail.com>
Signed-off-by: Ziming Huang <48115868+ZeldaHuang@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-01 19:12:36 +08:00 |
|
|
|
9e905f7450
|
[Bugfix] Account for client queue time in serve benchmarks (#54136)
Signed-off-by: maithilijoshi20 <maithilijoshi2003@gmail.com>
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
Signed-off-by: maithilijoshi20 <maithilij2003@gmail.com>
Co-authored-by: maithilijoshi20 <maithilijoshi2003@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-01 03:40:51 -07:00 |
|
|
|
92ccd2c306
|
[Bugifx][INC] Fix INC quantization method selection for non-quantized layers (#47237)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-01 10:40:47 +00:00 |
|
|
Cyrus Leung
|
754d5e1f65
|
[CI/Build] Fix entrypoints coverage (#54750)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-01 03:33:02 -07:00 |
|
|
Kevin H. LuuandCodex
|
504bb8b0c3
|
[CI] Add repository-local OTel tracing helpers (#52851)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-01 02:36:46 -07:00 |
|
|
|
8f03625b3d
|
[CPU][Zen] Route Int8 MoE inference through zentorch on AMD (#44834)
Signed-off-by: R <Ganesh.R@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-01 09:31:31 +00:00 |
|
|
AlexHuangandOr Ozeri
|
c35551f892
|
[Bugfix][KV Offload] Isolate tiering shutdown failures (#52290)
Signed-off-by: Alex <jihui.huang@daocloud.io>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-09-01 12:24:54 +03:00 |
|
|
Subhash Polisetti
|
4707679cd2
|
[Bugfix][MiniCPM-V] Route video_embeds to the shared vision parser (#54633)
Signed-off-by: subhash polisetti <subhashr161347@gmail.com>
|
2026-09-01 09:16:07 +00:00 |
|
|
xiangdongandKunshang Ji
|
5414b4e694
|
[XPU][TEST] Add entrypoints test in Intel GPU CI (#53980)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-01 16:57:55 +08:00 |
|
|
lzhan011andCyrus Leung
|
ce7391712b
|
[Bugfix][Security] Bound embedding densification before to_dense() (#54632)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-01 08:45:14 +00:00 |
|
|
waizuichougou
|
8905633687
|
[Bugfix][Frontend] Preserve token offset origins after left text pre-trimming (#54692)
Signed-off-by: waizuichougou <2082431897@qq.com>
|
2026-09-01 08:02:56 +00:00 |
|
|
stefankoncarevic
|
b65af5e339
|
[CI][ROCm] Expand weight loading test coverage on AMD and cap its KV cache (#54037)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-09-01 02:57:22 -05:00 |
|
|
fxmarty-amdandAndreas Karatzas
|
63988f3c2d
|
[Quantization][Refactor][1/N] Adopt QuantKey in QuarkConfig and methods, relying on weight_quant_key, act_quant_key for quant method dispatch (#52958)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-09-01 02:55:54 -05:00 |
|
|
dharak-cohereandCursor
|
d0e695a91b
|
[Distributed] Support pre-shared ncclUniqueId rendezvous for weight transfer (#53784)
Signed-off-by: Dharak Kharod <dharak.kharod@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 14:55:57 +08:00 |
|
|
lzhan011
|
fa99a6fea6
|
[Bugfix][Security] Bound the validation-error response body (#54684)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
|
2026-09-01 06:51:16 +00:00 |
|
|
|
4ac452ad98
|
[Core] Release NCCL communicator memory in sleep mode (#51485)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-01 14:31:16 +08:00 |
|
|
Jan Kwieciński
|
ec32f669bb
|
[Feature][MM_UUIDs] Allow empty video URLs when using multi-modal UUIDs (#54220)
Signed-off-by: Jan Kwiecinski <jkwiecinski@nvidia.com>
|
2026-09-01 05:55:27 +00:00 |
|