 velonica0andLi, Jiang <jiang1.li@intel.com>
|
ac7509e2b1
|
[Bugfix][CPU][RISC-V] Fix build: make FP32Vec copy constructors non-explicit (#51099)
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-08-14 04:59:01 +00:00 |
|
|
|
6adad08767
|
Add Muse Glimmer model support (#51655)
Signed-off-by: Tiezhen Wang <tiezhen@inferact.ai>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Beto de Paola <betodepaola@meta.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: zixi-qi <zixi@inferact.ai>
|
2026-08-14 12:28:56 +08:00 |
|
|
|
59d1af5698
|
Detect ROCm wheel variant from environment for precompiled wheels. (#49365)
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-13 21:19:20 -07:00 |
|
|
Tzu-Ling KanandClaude Opus 4.8
|
653cc6faca
|
[Bugfix][NIXL] Include transfer mode (push/pull) in the compatibility hash (#50620)
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-14 12:11:22 +08:00 |
|
|
|
c05d75aaa9
|
[Bugfix][Refactor] Keep Qwen3Next layer boundaries sequence parallel (#50685)
Signed-off-by: kunzh <RimeK20@outlook.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-08-14 11:58:32 +08:00 |
|
|
|
1be3628367
|
[Kernel][Perf] Add fused CUDA post-conv MTP decode kernel for Qwen3.5 GDN (#51674)
Signed-off-by: Jie Fang <jief@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-14 11:44:45 +08:00 |
|
|
Qiming Zhang
|
d18bb7b390
|
[UT] fix device of test_outputs.py (#52237)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-14 11:29:54 +08:00 |
|
|
Luke Alonso
|
3c79b1a8bf
|
[Kernel] Add B12X dense linear backends (#52016)
Signed-off-by: Luke Alonso <lalonso@gmail.com>
|
2026-08-13 19:48:33 -07:00 |
|
|
zofia
|
fe4c5dcd4c
|
[XPU] [Bugfix] process ragged weights in xpu linear backend (#52118)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
|
2026-08-14 09:11:43 +08:00 |
|
|
|
b216db3ed0
|
[Bugfix] Reject negative token ids as out-of-vocabulary (#51795)
Signed-off-by: Junhao Shen <junshen@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
|
2026-08-14 01:07:29 +00:00 |
|
|
|
827a2af806
|
[Kernel] Gemma-4 FA4 FP8 Kernel (#48666)
Signed-off-by: Qixiang Lin <qixiangl@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Qixiang Lin <qixiangl@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-08-13 17:42:00 -07:00 |
|
|
Junhao ShenandClaude Opus 4.8
|
38f097fab8
|
[Bugfix] Reject NUL byte in structured_outputs.regex (#51796)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-14 00:08:36 +00:00 |
|
|
Giancarlo DelfinandClaude Fable 5
|
f80b66f548
|
[Model Runner V2][Spec Decode] Add KV cache support for multi-layer MTP (#50062)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-13 16:22:29 -07:00 |
|
|
bastefaniak
|
71b0da7c4e
|
[Bugfix] Fix .../mrope.py::apply_interleaved_rope() when torch.compile is used in torch==2.13 (#52005)
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
|
2026-08-13 22:08:40 +00:00 |
|
|
Benjamin Chislett
|
51def7848a
|
[Bugfix] Reapply 50869 (#52223)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-08-13 15:08:07 -07:00 |
|
|
Stan WozniakandThomas Parnell
|
63550515b4
|
[Bugfix] Correct prompt lengths for timed_traces benchmark (#45423)
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
|
2026-08-13 21:51:24 +00:00 |
|
|
|
b652dedd0c
|
[Attention] Fix FlashInfer SM12x prefill with sinks (#52148)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-08-13 14:25:09 -07:00 |
|
|
Misha Goin
|
2e2ffd104b
|
[CI Failure] Fix CUDA wheel build for the Kimi K3 fused MLA kernel (#52210)
|
2026-08-13 13:56:36 -07:00 |
|
|
wangxiyuan
|
73b83949f7
|
[Platform] Add check_runner_kv_caches_multi_layer (#51633)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2026-08-13 19:25:07 +00:00 |
|
|
stefankoncarevic
|
11c3fa4adc
|
[Bugfix][ROCm][CI] Give the AITER MLA decode metadata stub its MLA dims (#52139)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-13 13:35:00 -05:00 |
|
|
|
c5b7c069a4
|
[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-13 13:12:40 -05:00 |
|
|
yzong-rh
|
e6b2a8ad5e
|
[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#50595)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-13 14:07:59 -04:00 |
|
|
fxmarty-amd
|
48825acc23
|
[Quantization] Remove dead QuantizationConfig.is_mxfp4_quant (#51793)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-08-13 13:58:31 -04:00 |
|
|
Andreas Karatzas
|
b96bcd0b47
|
[ROCm][CI] Solidify entrypoint LLM lifecycle (#51280)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-13 12:24:02 -05:00 |
|
|
Cyrus Leung
|
69d4c3a06b
|
Auto-ping Cohere on related issues (#52091)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-13 16:40:38 +00:00 |
|
|
Nick Iusiumbeli
|
83d4c6196a
|
[Bugfix] Declare SupportsEagle3 on KimiLinearForCausalLM (#52171)
Signed-off-by: Nick Iusiumbeli <nickuspro@gmail.com>
|
2026-08-13 16:22:50 +00:00 |
|
|
Harry Mellor
|
b245d8e73f
|
Apply logit softcapping in Transformers modelling backend (#52173)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-13 16:21:55 +00:00 |
|
|
Thien Tran
|
6014f9e672
|
[Kimi-K3] Add GEMM-RS for sequence parallelism (#52079)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-08-13 09:02:28 -07:00 |
|
|
Qiming Zhang
|
96acd473a7
|
[Bugfix][MiniCPM-V] Fix AssertionError in get_dummy_mm_data when passing VideoDummyOptions to _get_dummy_images (#52122)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-08-13 15:44:03 +00:00 |
|
|
Ali JaseemandClaude
|
64ca614fe4
|
[Bugfix] Fix --data-parallel-start-rank 0 being treated as unset in create_engine_config (#47692)
Signed-off-by: Syed Ali Jaseem <syedali0057@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-13 15:12:26 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
80d6d557f3
|
Standardise weight tying on ParallelLMHead.tie_weights (#52147)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-13 15:10:09 +00:00 |
|
|
|
7553aac77b
|
[Frontend] Add routed-experts prompt offset (#51906)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-13 08:09:00 -07:00 |
|
|
vllmellm
|
f3c1638927
|
[ROCm] Enable V2 model runner for Kimi-K3 on ROCm (#51653)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
|
2026-08-13 14:34:53 +00:00 |
|
|
Michael Goin
|
2d24355eb8
|
[Bugfix] Fix packed GDN decode launch for large batch-head grids (#52030)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-13 07:19:08 -07:00 |
|
|
范裕达
|
170592a931
|
[Bugfix] Disable sequence parallelism for Dots3 NOTE (#52172)
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com>
|
2026-08-13 22:13:00 +08:00 |
|
|
|
95c9144424
|
[LoRA][Gemma4] Support vision tower LoRA (#42662)
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <joy25810@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: linitra24 <joy25810@gmail.com>
|
2026-08-13 22:07:43 +08:00 |
|
|
zexplorerhj
|
8e1131e1d1
|
[Model] [Quantization] Add Ling hybrid MXFP4 routed experts support (#52114)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
|
2026-08-13 21:46:53 +08:00 |
|
|
yang rui
|
152c913a63
|
[Frontend] Log output token IDs at DEBUG level (#52098)
Signed-off-by: ruirui6946 <142162413+ruirui6946@users.noreply.github.com>
|
2026-08-13 13:11:51 +00:00 |
|
|
Vineeta TiwariandVineeta Tiwari
|
015660da91
|
[Misc] Add missing return type annotations in outputs.py (#52145)
Signed-off-by: Vineeta Tiwari <vineeta.tiwari2@ibm.com>
Co-authored-by: Vineeta Tiwari <vineeta.tiwari2@ibm.com>
|
2026-08-13 12:58:45 +00:00 |
|
|
pmanczak
|
c4e969294e
|
[XPU] Add tuned Mamba SSU configs for Intel Arc Pro B70 (#50534)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
|
2026-08-13 12:36:55 +00:00 |
|
|
Taneem Ibrahim
|
d0ae25e2f2
|
[Bugfix] Preserve Anthropic disable_parallel_tool_use (#52021)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-13 08:25:55 -04:00 |
|
|
JasonCohere
|
5fee0a872d
|
chore: Upstream Cohere parser fixes + tests (#51998)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
|
2026-08-13 05:05:36 -07:00 |
|
|
QWERQWERQWE86
|
443fa5aca0
|
[Doc] Fix stale rejection_sample_method and synthetic_acceptance_rate (#51611)
Signed-off-by: qwerqwerqwe8688-jpg <xuuuuu2021@163.com>
|
2026-08-13 10:56:27 +00:00 |
|
|
Juan Pérez de Algaba
|
37c3bdf5a7
|
fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-13 03:31:55 -07:00 |
|
|
Thomas Ortner
|
b8baa31a28
|
Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
|
2026-08-13 11:21:50 +01:00 |
|
|
Harry Mellor
|
903da602f3
|
[Docs] Fix WhisperEncoderLayer.forward docstring in dots3_note (#52134)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-13 02:32:14 -07:00 |
|
|
Li, Jiang
|
1c3633acaf
|
[CI/Build][CPU] Shrink triton-cpu-build layer by dropping build artifacts (#52127)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-08-13 17:17:00 +08:00 |
|
|
kliuae
|
f96261637c
|
[ROCm][Perf] Kimi-K3 Remove prefill pipeline stall in chunk KDA (#51862)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
|
2026-08-13 09:11:45 +00:00 |
|
|
|
50ba4bc6b2
|
[Feature] Mask Replay (#49577)
Signed-off-by: vx120 <893600387@qq.com>
Signed-off-by: vx120 <57470515+vx120@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-13 08:44:31 +00:00 |
|
|
Cyrus Leung
|
10bcad2523
|
Update CODEOWNERS (#52123)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-13 08:43:07 +00:00 |
|