 Jiangyun Zhu
|
2ae73c758c
|
[Bugfix] fix inductor error for dpsk v4 (#41135)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-04-28 21:18:46 -07:00 |
|
|
Fadi Arafeh
|
d95d03c719
|
[BugFix][CPU] fix error on CPU runner shutdown (#41034)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-04-28 21:08:35 -07:00 |
|
|
Wei Zhao
|
803b9d7881
|
[Bugfix] Fix Deepseek V4 import error due to AOT compile cache loading (#41090)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-04-28 21:08:16 -07:00 |
|
|
Walter Beller-Morales
|
1312f07531
|
[Feature] add cohere reasoning and tool parsers (#40422)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
|
2026-04-28 21:07:53 -07:00 |
|
|
Lucas KabelaandWentao Ye
|
fa1b9840f6
|
[BE][Torch 2.12] Remove workaround code for fixed cublas issue (#40845)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-04-28 21:07:24 -07:00 |
|
|
Kyle SayersandFlora Feng
|
916e56c05c
|
[QeRL] Add warnings for extra memory buffering (#40309)
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-04-28 21:06:54 -07:00 |
|
|
Kyle SayersandFlora Feng
|
a085b5257d
|
[Docs] [QeRL] Layerwise Reloading Documentation (#40317)
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-04-28 21:06:38 -07:00 |
|
|
liangel-02
|
7fd05e05ae
|
uncomment flex backend for batch invariant mode (#40842)
Signed-off-by: Angel Li <liangel@meta.com>
|
2026-04-28 21:05:14 -07:00 |
|
|
Isotr0pyandCopilot
|
99255f3cb5
|
[UX] Allow enable/disable model weights loading tracking by config (#41086)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Copilot <copilot@github.com>
|
2026-04-28 21:04:49 -07:00 |
|
|
haosdent
|
75a7cf2c10
|
[CI] De-flake test_chat_completion_n_parameter_non_streaming (#41147)
Signed-off-by: haosdent <haosdent@gmail.com>
|
2026-04-29 03:23:59 +00:00 |
|
|
haosdent
|
4b95e9cec4
|
[CI] Return HTTP 400 for unsupported chat content part type (#41121)
Signed-off-by: haosdent <haosdent@gmail.com>
|
2026-04-29 10:23:26 +08:00 |
|
|
rasmith
|
856b15c62c
|
[CI][AMD][BugFix] Patch has_flashinfer decorator for test_select_rocm_aiter_backend (#41072)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
|
2026-04-29 02:12:17 +00:00 |
|
|
qizixi
|
6fb3f7b46b
|
[DSV4] Align aux stream API with DeepseekV4DecoderLayer (#41171)
Signed-off-by: zixi-qi <zixi@inferact.ai>
|
2026-04-28 17:22:03 -07:00 |
|
|
chelnnexy
|
d109eacd05
|
[Bugfix][ROCm] Fix gemm_a4w4 call to use updated AITER API signature (#40754)
Signed-off-by: cheiluno <cheiluno@amd.com>
|
2026-04-29 09:04:53 +09:00 |
|
|
Nick Hill
|
e68fa1b90a
|
[Core] Account for num_gpu_blocks_override in max_model_len checks (#41069)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-04-28 15:44:09 -07:00 |
|
|
Russell Bryant
|
f05f3664c3
|
[Doc] Add missing API endpoints to security documentation (#40532)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2026-04-28 21:53:19 +00:00 |
|
|
Julien Denize
|
e9f8f31e9a
|
[FEATURE] Add EagleMistralForCausalLM (#41024)
Signed-off-by: juliendenize <julien.denize@mistral.ai>
|
2026-04-28 12:22:20 -07:00 |
|
|
yangrzandRoger Wang
|
de3fe8dc62
|
[Bugfix] release KV blocks for skipped P-ranks to prevent invalid KV errors and timeouts when P_tp > D_tp and MLA (#40449)
Signed-off-by: yangruize <yangruize7@163.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-04-28 11:38:43 -07:00 |
|
|
Joe RowellandRobert Shaw
|
0899f436aa
|
[New Model] Laguna XS.2 implementation (#41129)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
|
2026-04-28 14:23:00 -04:00 |
|
|
rasmith
|
358a755e43
|
[CI][AMD][BugFix] Update request URL in test_moriio_connector to match vllm-router compatibility changes (#41076)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
|
2026-04-28 13:14:59 -05:00 |
|
|
Benoit Tigeot
|
a60883644b
|
[Build] Defer flashinfer cubin download to avoid ~2.5 GB (decompressed) layer duplication (#41134)
Signed-off-by: Benoit Tigeot <benoit.tigeot@lifen.fr>
|
2026-04-28 10:27:18 -07:00 |
|
|
Yongye Zhu
|
5aa371dc8e
|
[DSV4] Enable Multi-stream for Pre-Attn GEMM (#41061)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-04-28 09:08:55 -07:00 |
|
|
zhangxin81
|
de3da0b97c
|
Add tuned triton fused_moe configs on H100 for gpt-oss (#39904)
Signed-off-by: zhangxin81 <115389973+zhangxin81@users.noreply.github.com>
|
2026-04-28 03:38:48 -07:00 |
|
|
Roy Wang
|
9e92de51c6
|
[Bugfix] Exclude numa_bind fields from ParallelConfig DP hash (#41098)
Signed-off-by: yasong <yasong.wang@inferact.ai>
|
2026-04-28 15:52:54 +08:00 |
|
|
artem-spectorandartemspector
|
bde0efdbb7
|
[Bugfix][Granite4Vision] Fix deepstack buffer causing decode slowdown in compiled mode (#40917)
Signed-off-by: artemspector <artems@il.ibm.com>
Co-authored-by: artemspector <artems@il.ibm.com>
|
2026-04-28 07:43:30 +00:00 |
|
|
zhrrr
|
ea74f701db
|
Bugfix: fix SpecBench sample argument error (#40927)
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
|
2026-04-28 00:33:49 -07:00 |
|
|
wang.yuqi
|
a8208e6a81
|
[Examples] Resettle features examples. (#40995)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-04-28 00:33:41 -07:00 |
|
|
anthonsu
|
76c9cccc36
|
[Core] Fix redundant None append in StepPool.forward for chunked prefill (#41049)
Signed-off-by: Anthony Su <xsuanthony@gmail.com>
|
2026-04-27 23:42:47 -07:00 |
|
|
JiangWeixiang
|
ed57f77192
|
[Bugfix ] fix bailing_moe_linear (#40859)
Signed-off-by: ghphotoframe <854746559@qq.com>
|
2026-04-27 22:39:23 -07:00 |
|
|
|
7a1eb8ac2e
|
[Model] update for mimo v25 (#41029)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Copilot <copilot@github.com>
|
2026-04-27 21:52:54 -07:00 |
|
|
Isotr0py
|
c2e88a281c
|
[Bugfix] Fix broken example opeanai client (#41088)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-04-28 04:43:04 +00:00 |
|
|
Matthew Bonanni
|
fd74c90d9c
|
[Attention][Spec Decode] Allow independent drafter attention backend selection (#39930)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-04-27 19:38:09 -07:00 |
|
|
Chauncey
|
146f44b77d
|
[Frontend]Responses API supports Tool/Function calling with streaming with required (#40700)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-04-27 19:36:58 -07:00 |
|
|
yzong-rhandFlora Feng
|
0d4f714208
|
[Bugfix] Remove tokenizer encode/decode calls from Olmo3 reasoning parser (#40855)
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-04-27 19:36:54 -07:00 |
|
|
Angela Yi
|
03aeed802f
|
[Test] Fix test_dynamic_shapes_compilation for torch 2.12 (#40743)
Signed-off-by: Angela Yi <angelayi@meta.com>
|
2026-04-27 17:51:15 -07:00 |
|
|
Jee Jee Li
|
2c8b76c5cb
|
[Model][DSV4] Support base model (#41006)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-04-28 08:16:55 +08:00 |
|
|
Kunshang Ji
|
407b34be26
|
[xpu] bump up vllm-xpu-kernel v0.1.7 (#41019)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-28 08:04:54 +08:00 |
|
|
Giancarlo Delfin
|
4c7c69b4e0
|
[Model Runner V2] Skip attention metadata rebuild before draft prefill (#40410)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-04-27 15:38:05 -07:00 |
|
|
Andreas Karatzas
|
5e2c37facd
|
[ROCm][CI] Add missing quantization methods and fix online quant test failures (#39801)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-04-27 15:08:57 -05:00 |
|
|
|
c8bbe05189
|
[Perf] Update TRTLLM supported MoE routing methods (#39141)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: root <root@bia0030.bia.clusters.nvidia.com>
Co-authored-by: root <root@bia0036.bia.clusters.nvidia.com>
|
2026-04-27 14:16:22 -04:00 |
|
|
|
6232fb4b66
|
[Docker] Install numactl CLI in CUDA runtime image (#41032)
Signed-off-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-27 10:58:06 -07:00 |
|
|
Moritz Sanft
|
2c06cf3486
|
[Bugfix] use served_model_name for multimodal error message (#41003)
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
|
2026-04-27 08:22:35 -07:00 |
|
|
Harry Mellorandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e6f710a87f
|
Deprecate support for Transformers v4 (#40389)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-04-27 08:19:57 -07:00 |
|
|
|
c245d35ff4
|
[Model] Add MiMo-V2.5 support (#40967)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <zhujiangyun@inferact.ai>
Co-authored-by: yasong <yasong.wang@inferact.ai>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Copilot <copilot@github.com>
|
2026-04-27 13:26:51 +00:00 |
|
|
Xiaoshuang Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f8ac0c7cf0
|
[Bugfix] Fix k_norm weight sharding in MiniMaxM2Attention when total_num_kv_heads < tp_size (#38191)
Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Icey <1790571317@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-04-27 05:57:13 -07:00 |
|
|
Simon MoandClaude
|
ebf862c351
|
Add system_fingerprint field to OpenAI-compatible API responses (#40537)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-27 16:17:52 +08:00 |
|
|
wang.yuqi
|
8d8062d0a7
|
[Examples] Resettle generate examples. (#36464)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-04-27 07:48:37 +00:00 |
|
|
Roy WangandRoger Wang
|
985961345a
|
[Bugfix] Install libcublas-dev in Dockerfile for FlashInfer CuTe DSL JIT (#39855)
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-04-27 15:47:39 +08:00 |
|
|
Yongye Zhu
|
706a04d34b
|
[DSV4] Add silu clamp limit to shared expert (#40950)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-04-27 00:37:43 -07:00 |
|
|
Isotr0py
|
22631f80a0
|
[Bugfix] Remove invalid deepstack boundary check for Qwen3-VL (#40932)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-04-27 07:27:06 +00:00 |
|