 TrainToGPBandClaude
|
eb3dce9757
|
[Bugfix][Model] Gemma3n/Gemma4: pad variable-length audio batches (#50958)
Signed-off-by: TrainToGPB <kaiba0514@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-05 12:46:00 +08:00 |
|
|
Michael Goin
|
9cd9f8c20b
|
Prune redundant tests points in correctness_e2e/[test_sequence_parallel,test_async_tp] (#51068)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-04 19:18:50 -07:00 |
|
|
Wentao Ye
|
d31de3c421
|
[Kimi K3 Perf] option to shard the shared expert for non mega case, 16.98 GiB memory/GPU saved (#50912)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-04 14:00:44 -04:00 |
|
|
|
7ac2ec7582
|
[Kimi-K3][AMD] Fuse AttnRes state updates and norms (#50593)
Signed-off-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 12:32:13 -04:00 |
|
|
|
166f4e2dc3
|
fix: fuse weightless RMSNorms at their declared width (#50867)
Signed-off-by: Anuj Bolewar <anujbolewar@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Anuj Bolewar <anujbolewar@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-04 16:03:09 +00:00 |
|
|
Jiangyun Zhuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f9c74b4b9c
|
[Mamba] enable prefix cache by default (#50991)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 15:20:51 +00:00 |
|
|
Harry Mellor
|
59b2fdfc4e
|
Support MLA properly in the Transformers modeling backend (#48250)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-04 13:24:11 +01:00 |
|
|
Lazurite
|
6a9fdf0dc7
|
[Bugfix] Resolve seq-cls num_labels from the top-level config for multimodal checkpoints (#50950)
Signed-off-by: Lazurite <43494437+Rapisurazurite@users.noreply.github.com>
|
2026-08-04 11:39:39 +00:00 |
|
|
fxmarty-amdandAndreas Karatzas
|
385d4c084e
|
[ROCm][AITER] Hotfix for memory access fault errors in AITER triton MOE routing (#50859)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-03 21:07:46 -05:00 |
|
|
Andreas Karatzas
|
8adc840c45
|
[ROCm][Test] Use BF16 for Jina v5 nano MTEB test (#50917)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-04 08:33:05 +08:00 |
|
|
Ryan HambyandIsotr0py
|
6a9109d865
|
[Bugfix] Fix Qwen3-Omni crash on video with no audio track when use_audio_in_video=True (#48420)
Signed-off-by: RyanJHamby <ryanhamby22@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-03 16:22:00 -07:00 |
|
|
|
5df9999fcf
|
[Kimi-K3] Add option to shard the shared expert instead of replicating (#50656)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-03 11:41:24 -04:00 |
|
|
wangxiyuan
|
dd11df04f3
|
[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2026-08-03 11:15:13 -04:00 |
|
|
Kyungmin Leeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9ae11a6b89
|
[Model] Add K-EXAONE-2.0-750B-A37B (#50524)
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-03 06:33:02 -07:00 |
|
|
wang.yuqi
|
9acb7b3699
|
[CI] And PPL test for multimodal generation models (#50839)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-03 11:25:08 +00:00 |
|
|
Omkar Shewale
|
9a4fd57cac
|
[Model] Support jina-embeddings-v5-text-nano (EuroBERT encoder backbone) (#50688)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
|
2026-08-03 01:37:08 +00:00 |
|
|
chun-wan
|
0033211c0b
|
[Test][V1] Add sleep/wake correctness regression test for hybrid GDN/… (#44972)
Signed-off-by: chun-wan <chun-wan@amd.com>
|
2026-08-02 22:02:42 +00:00 |
|
|
Taneem Ibrahim
|
55c98e370a
|
[Model Runner v2] Enable BGE M3 pooling embed token_classify (#50661)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-02 12:46:03 -04:00 |
|
|
Woosuk Kwon
|
38a466e7b6
|
[DSV4] Implement Sequence Parallelism (#46789)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-01 10:22:33 -07:00 |
|
|
Taneem Ibrahim
|
652ba59229
|
[Model Runner V2] Enable encoder token embedding (#50574)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-01 07:55:36 -04:00 |
|
|
|
fcdc7c2e9c
|
[CI] Organize speculative decoding E2E tests by coverage (#50330)
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-31 18:05:42 -07:00 |
|
|
Oğuzhan KIR
|
7fdc1ab29e
|
[CI] Remove default_torch_num_threads workaround from llava-onevision-transformers test (#50560)
Signed-off-by: oguz <oguzhankir17@gmail.com>
|
2026-07-31 12:29:31 +00:00 |
|
|
Isotr0py
|
1180b604f8
|
[Multimodal] Expose mm hash algothrim selection to cli args (#49686)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-31 05:25:19 +00:00 |
|
|
Taneem Ibrahim
|
0f17394564
|
[Model Runner V2] Enable encoder token classification (#50293)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-07-31 04:15:36 +00:00 |
|
|
Sebastian WooandClaude
|
bebf918044
|
[Bugfix][Model] Reject encoder-backbone jina-embeddings-v5 checkpoints with a clear error (fixes #50337) (#50352)
Signed-off-by: seewoo <seewoo@ucsc.edu>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-31 11:43:31 +08:00 |
|
|
+1
|
4f1da84eb5
|
Enable gfx1250 ROCm architecture (#46516)
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Signed-off-by: jpvillam <juan.villamizar@amd.com>
Signed-off-by: Daniel <danichan@amd.com>
Signed-off-by: Jaden Mathias <jaden.mathias@amd.com>
Signed-off-by: jpvillam <jpvillam@amd.com>
Signed-off-by: Juan Villamizar <100237675+jpvillam-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Jaden Mathias <Jaden.Mathias@amd.com>
Co-authored-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Daniel <danichan@amd.com>
Co-authored-by: Jaden Mathias <jaden.mathias@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: root <root@ctheliosr-1b114-f01-2.mnb.dcgpu>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: dllehr <douglehr@amd.com>
Co-authored-by: Daniel Chan <Daniel.Chan@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-31 01:41:12 +00:00 |
|
|
Kunshang Ji
|
f388dd6592
|
[XPU][CI] skip kimi-k3 test (#50447)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-30 08:27:28 -07:00 |
|
|
Julien Denize
|
1a20d23dab
|
[PARSER][Mistral] unified engine-based parser for reasoning and tool calls (#48947)
|
2026-07-30 15:38:00 +02:00 |
|
|
Martin HickeyandHarry Mellor
|
38a267cdd5
|
[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-30 05:02:51 -07:00 |
|
|
+13
|
aeeb36b1f1
|
[New model] Kimi K3 (#50000)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-07-30 03:49:58 -07:00 |
|
|
christian
|
9d1aa4dda8
|
[Frontend] Add diarized_json support for MOSS-Transcribe-Diarize (#48543)
Signed-off-by: Lucas Christian <lucaschgf7@gmail.com>
|
2026-07-29 23:24:30 +00:00 |
|
|
Taneem Ibrahim
|
43eaefba5a
|
[ModelRunner V2] Enable sequence pooling for embedding and classification models (#48791)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-07-29 06:30:45 -07:00 |
|
|
stefankoncarevic
|
625871b52c
|
[CI][Test] Fix pooling truncation test after VLLMError hierarchy change (#50241)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
|
2026-07-29 12:15:56 +00:00 |
|
|
Perkz ZhengandPerkz Zheng
|
ad5d29db70
|
[Model] Support Qwen3.5 text-only dense and MoE models (#50210)
Signed-off-by: Perkz Zheng <PerkzZheng@users.noreply.github.com>
Co-authored-by: Perkz Zheng <PerkzZheng@users.noreply.github.com>
|
2026-07-29 08:21:57 +00:00 |
|
|
+12
|
7c6729b769
|
[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-07-29 14:10:58 +08:00 |
|
|
Zach Zhu
|
58f9659397
|
[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)
Signed-off-by: Zach Zhu <zzqshu@126.com>
|
2026-07-29 04:20:40 +00:00 |
|
|
|
17a74b745b
|
[Model] Add Inkling compressed-tensors dynamic FP8 support (#48876)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-28 19:27:01 -07:00 |
|
|
fxmarty-amd
|
5369f7b7b8
|
[MXFP8][ROCm] Fix MXFP8 MoE backend selection (#49747)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-07-29 07:57:20 +08:00 |
|
|
labAxiaoming
|
1db989bbf1
|
[Bugfix][Multimodal] Fix video temporal padding estimates (#49030)
Signed-off-by: xiaoming <1259730330@qq.com>
|
2026-07-29 01:57:31 +08:00 |
|
|
Thien Tran
|
61ac368021
|
[Kimi-K3] Add AttnRes kernels (#50090)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-07-28 00:22:09 -07:00 |
|
|
Yan Ma
|
73af7a362a
|
[XPU] Add online fp8 quantization test (#44513)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-07-28 10:34:33 +08:00 |
|
|
Miłosz GrunwaldandHarry Mellor
|
ebcef33766
|
Fix MQA with tensor parallelism on transformers modeling backend (#49987)
Signed-off-by: microslaw <milosz.grunwald@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-27 22:51:17 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
99de48e98f
|
Fix MLA padding and grouped topk routing in the Transformers modelling backend (#49982)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-07-27 18:32:32 +00:00 |
|
|
Harry Mellor
|
92e8518d37
|
Improve Transformers modelling backend fx tracer (#49957)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-27 12:51:16 +01:00 |
|
|
TJianandOpenAI Codex
|
0906123953
|
[ROCm] [Model] Enable TML inkling (#48841)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-27 10:05:46 +00:00 |
|
|
Nick HillandTaneem Ibrahim
|
fdaa0d9e59
|
[ModelRunner V2] Support encoder-only attention (#49331)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-07-27 00:38:44 +00:00 |
|
|
Athrael Soju
|
1240c74c0a
|
[Bugfix] Respect declared attention contract for ColQwen3.5 retrievers (#49372)
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
|
2026-07-26 04:08:07 +00:00 |
|
|
anthonsuandLinkun Chen
|
70009fb934
|
[MM][CG] Support ViT CUDA Graph for Gemma-4 (#46837)
Signed-off-by: Anthony Su <xsuanthony@gmail.com>
Co-authored-by: Linkun Chen <github@lkchen.net>
|
2026-07-25 15:02:09 -05:00 |
|
|
Harry Mellor
|
26d725c334
|
[Model] Add VaultGemma via Transformers modeling backend (#49803)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-25 16:54:15 +00:00 |
|
|
|
b9b6306ebe
|
feat[vLLM × v5]: Add audio support for the Transformers backend (#39330)
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-25 04:20:58 -07:00 |
|