 Zupeng Wang
|
7b7e5cbfcd
|
[Bugfix][LoRA] Restore tower and connector LoRA support for LFM2-VL (#53519)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
|
2026-08-25 01:53:04 +00:00 |
|
|
Kevin H. LuuandCodex
|
34c3824a11
|
[CI] Increase Entrypoints Unit timeout after launcher suite growth (#53618)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-25 01:48:57 +00:00 |
|
|
kiroxuandOpenAI Codex
|
07ef21bc69
|
[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-24 18:28:49 -07:00 |
|
|
drakoshaandClaude
|
9bf0d4717e
|
[Bugfix] Keep grid dims for XD-RoPE models on a prefix-cache hit (#53456)
Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-25 01:14:32 +00:00 |
|
|
Nick Hill
|
09fddeb4ce
|
[Bugfix] BailingMoeV3 KDA: skip absent metadata during CUDA graph profiling (#53593)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-25 01:02:50 +00:00 |
|
|
Andrey Talman
|
e3dde1ee9b
|
[CI] Report torch-nightly results to PyTorch CRCR (#51830)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-08-24 18:00:13 -07:00 |
|
|
|
7ca336929c
|
[Model] Remove ten deprecated model architectures (#53608)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-24 17:06:00 -07:00 |
|
|
rasmith
|
a0f1b9ad05
|
[CI][The Rock] Increase flex attention abs tol (#53646)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
|
2026-08-24 23:57:03 +00:00 |
|
|
Giancarlo Delfin
|
d154d90d6c
|
[Model Runner V2] batch-sharded sample (#50465)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-08-24 15:49:57 -07:00 |
|
|
Juan Pérez de Algaba
|
0d7d5ed0b2
|
fix(security): enforce VLLM_MAX_AUDIO_CLIP_FILESIZE_MB on all audio paths (#53561)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-24 21:37:02 +00:00 |
|
|
Khushali Desai
|
23ab0cfdbc
|
speculative decoding under tensor parallelism (TP>1) , workspace creation select max hidden dim of target and draft model (#52193)
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
|
2026-08-24 21:33:36 +00:00 |
|
|
Wentao Ye
|
f59bb0bd8c
|
[Refactor] Refactor batch invariance folder (#53619)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-24 14:31:36 -07:00 |
|
|
Guan-Ming Chiu
|
6a9c69fa85
|
[Attention][Spec Decode] Support varlen trtllm-gen decode for adaptive verification (#52157)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-08-24 14:43:57 -04:00 |
|
|
Prudhvi Vudaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
342b8ebd8b
|
[Bugfix][Multimodal] Encode text in mixed CLIP/SigLIP pooling batches (#53165)
Signed-off-by: Prudhvivuda <prudhvi12042001@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-24 10:45:42 -07:00 |
|
|
Jee Jee LiandCyrus Leung
|
4f686e182a
|
[MISC] Cleanup deprecated parameters (#53559)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 10:19:04 -07:00 |
|
|
Ning Xie
|
6648eb118d
|
[Core] drop duplicate VLLM_USE_DEEP_GEMM check (#48687)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-24 16:30:50 +00:00 |
|
|
Lio Einaudiandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
7797b6022c
|
[Kernel][Perf] Per-architecture tuned configs for batch-invariant persistent matmul (~3x decode kernels on RTX 4090D/H20) (#53247)
Signed-off-by: LioEinaudi <zhao3024667639@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-24 11:28:51 -04:00 |
|
|
Wentao Ye
|
29c9af5211
|
[Kimi K3 Refactor] Add UnfinalizedMoEOutput proto following up for #53152 (#53310)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-24 11:21:11 -04:00 |
|
|
Kevin H. LuuandCodex
|
4c56e62c85
|
[Bugfix][Kimi K3] Skip absent metadata during CUDA graph profiling (#53581)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-24 15:16:28 +00:00 |
|
|
Misha Goin
|
f620499ee3
|
[Bugfix][Spec Decode] Reapply group geometry for FlashAttention metadata (#53336)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-24 08:08:43 -07:00 |
|
|
wang.yuqi
|
9cef631f30
|
[Frontend] Move run_batch.py out openai folder (#53500)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-24 15:04:10 +00:00 |
|
|
cjackal
|
22099afc64
|
[Bugfix][DCP] Handle sparse MLA metadata after DCP Manager refactor (#52377)
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
|
2026-08-24 15:02:48 +00:00 |
|
|
Cyrus Leung
|
ecfa7bb373
|
[MM] Cache common token sequences (#53560)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-24 07:48:10 -07:00 |
|
|
石皮幼鸟andOpenAI Codex
|
4ca856b0b5
|
[Bugfix] Release worker RPC payload before next dequeue (#51979)
Signed-off-by: 石皮幼鸟 <2960474346@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-24 07:27:36 -07:00 |
|
|
Juan Pérez de Algaba
|
9f295fe8ce
|
[Docs][Security] Document multimodal media UUID security implications (#53582)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-24 07:19:18 -07:00 |
|
|
Taneem Ibrahim
|
79bb395eea
|
[Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-24 08:33:32 -04:00 |
|
|
andrewbcohere
|
41ae917c12
|
Add Cohere ChatV2 render endpoint (#53219)
|
2026-08-24 12:27:57 +00:00 |
|
|
Tan ChaoandClaude
|
e239947777
|
[Bugfix][Frontend] Fix run_batch upload retrying on success and unawaited error body (#50588)
Signed-off-by: Chao Tan <chaos.tc@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-24 11:33:44 +00:00 |
|
|
Nicolò Lucchesi
|
0ecc284790
|
[Bugfix][Kernel] Handle kernel block sizes in V2 DCP slot mapping (#51031)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-24 07:28:38 +00:00 |
|
|
Ace EldeibandCodex
|
a047e2543d
|
Fix MNNVL Lamport mailbox publication and cleanup (#53000)
Signed-off-by: Ace Eldeib <aeldeib@coreweave.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-23 23:56:54 -07:00 |
|
|
Quentin Gallouédec
|
26858770ec
|
[Bugfix] Reuse CUDA streams in packed weight transfer to cap reserved-memory waste (#52951)
Signed-off-by: Quentin Gallouédec <quentin.gallouedec@huggingface.co>
|
2026-08-23 23:54:41 -07:00 |
|
|
Louie Tsai
|
cc40c3673b
|
[Xeon][doc]add Xeon recipes into table (#53226)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-08-24 06:42:28 +00:00 |
|
|
|
a4d70bef37
|
[Model Runner V2] Reserve CUDA graph memory (#53306)
Signed-off-by: Anh Tran <anh.tran.3889@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Anh Tran <anh.tran.3889@gmail.com>
Co-authored-by: anhtra3889 <anhtra@nvidia.com>
|
2026-08-23 23:11:19 -07:00 |
|
|
linitra24
|
8c2bbe00d5
|
[Bugfix][LoRA] Add multimodal module mapping for Muse-Glimmer (#53513)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-24 05:51:43 +00:00 |
|
|
linitra24
|
460c08bc8a
|
[LoRA] Add Qwen3-Omni multimodal LoRA support (#52786)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
|
2026-08-24 05:25:23 +00:00 |
|
|
Summer Yang
|
e6e1af4ca1
|
[Perf] Tune FlashInfer all-reduce selection on SM103 (#53318)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
|
2026-08-24 05:19:59 +00:00 |
|
|
DaeHyun Sung
|
f94666b60d
|
[Bugfix][XPU] Skip oneCCL warm-up all_reduce when world_size == 1 (#52389)
Signed-off-by: DaeHyun Sung <dhsung@lablup.com>
|
2026-08-23 21:31:33 -07:00 |
|
|
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟andJee Jee Li
|
702e1d7186
|
[LoRA] feat: Support LoRA for DeepSeek V4 (#53361)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-24 03:57:57 +00:00 |
|
|
ThunGuoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e8888b2d68
|
[Model] Add FP8 quantization support for ModernBERT (#53101)
Signed-off-by: thunguo <tew@apache.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-24 03:04:19 +00:00 |
|
|
Clinton ThomasandLucas Bourtoule
|
2ec6f0d71e
|
Reject oversized media before fully downloading it (#51896)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
|
2026-08-24 01:15:09 +00:00 |
|
|
Dieter Schwarzmann
|
585bb07c70
|
feat: add SSE keep-alive comments for idle streaming responses (#51034)
Signed-off-by: fuzzifikation <40043768+fuzzifikation@users.noreply.github.com>
|
2026-08-23 18:13:02 -07:00 |
|
|
danisereb
|
a7195188a4
|
Add MTP support for Nemotron VL models (#53121)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
|
2026-08-24 00:59:56 +00:00 |
|
|
FrankandCodex
|
cd329413e2
|
[Misc] Use VLLMValidationError in Cohere request validation (#52467)
Signed-off-by: frank-suwen <suwenw2@outlook.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-08-24 00:52:27 +00:00 |
|
|
范裕达
|
185cada36b
|
[Model] Fix KV cache layout and optimize Dots3 NOTE Omni encoders (#53460)
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com>
|
2026-08-23 10:02:35 -07:00 |
|
|
Aaron Hao
|
6cd9713463
|
[RL] P2P RDT weight sync (#43375)
|
2026-08-23 09:42:22 -07:00 |
|
|
Jensen ChenandClaude Opus 5
|
39eba6ac36
|
[Misc] Use VLLMValidationError in offline inference input validation (#53432)
Signed-off-by: Jensen Chen <a1043904820@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-23 08:43:51 -07:00 |
|
|
Wyett
|
b26039b09f
|
Add routed expert loading for gpt-oss (#52209)
Signed-off-by: Wyett <wyettzeng@gmail.com>
Signed-off-by: wyett <wyettzeng@gmail.com>
|
2026-08-23 17:59:08 +08:00 |
|
|
Kevin H. LuuandOpenAI Codex
|
e25c586b90
|
[CI/Build] Pin Cython below 3.3 for arm64 tilelang sdist (#53358)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-23 01:09:27 -07:00 |
|
|
Cyrus LeungandQwen Code
|
ebcd606467
|
[MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
|
2026-08-23 14:50:32 +08:00 |
|
|
anmolgupt
|
a3561ef8e4
|
[Bugfix][Model] Mistral3: fix image placeholder grid for processor size overrides (#52874)
Signed-off-by: Anmol Gupta <14880251+anmolgupt@users.noreply.github.com>
|
2026-08-22 21:34:38 -07:00 |
|