 aoshen02
|
4eef91c03c
|
[Model] Support R3 capture with DeepGEMM MegaMoE (#51831)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
|
2026-08-12 01:07:07 -07:00 |
|
|
|
7f9173dfa2
|
[ROCm][Perf] Kimi-K3 Fused kernel for KDA decode (#50654)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-08-11 20:39:34 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
1ab2801dde
|
[ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-11 14:19:16 -04:00 |
|
|
Harry Mellor
|
9cc347ae42
|
Enable MiniCPMV for vLLM in CI (#45042)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 16:30:39 +00:00 |
|
|
Harry Mellor
|
c65aa2ee6c
|
Bump Transformers version to 5.15.0 (#51668)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-11 09:00:51 -07:00 |
|
|
|
6c95a641e9
|
[2/N][Feat][Perf] Add new warmup infrastructure for JITs. Add predicate filtering for JIT warmup, and migrate Inkling FA4 (#49315)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 07:46:07 -04:00 |
|
|
Khushali Desaiandwang.yuqi
|
dc5101fb1b
|
replace batch_norm to numerically identical without cudnn (#51734)
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-11 12:43:20 +08:00 |
|
|
Almog Tavor
|
c3cac8c63d
|
[Bugfix][MiMo] Apply vision attention sinks in the window attention path (#49815)
Signed-off-by: almogtavor <almogtavor@gmail.com>
|
2026-08-10 22:36:42 +00:00 |
|
|
Lyu, Xudong
|
0e2d78028c
|
[Bugfix][Kimi-K3] Give the AMD packed KDA decode kernel the state-index stride (#51682)
Signed-off-by: Lyu, Xudong <xudong.lyu@amd.com>
|
2026-08-11 00:05:20 +08:00 |
|
|
Harry Mellor
|
cf8f3a3bb2
|
[2/N] Harden Transformers modelling backend multi-modal path (#51657)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 12:57:12 +00:00 |
|
|
efschu
|
900d09f91a
|
[Bugfix][Model] Fix Qwen3.5 MTP for text-only checkpoints (#50734)
Signed-off-by: efschu <51944948+efschu@users.noreply.github.com>
|
2026-08-10 11:04:53 +00:00 |
|
|
Harry Mellor
|
70b84f0bcb
|
Fix Gemma 4 for upcoming Transformers version (#49797)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-10 07:48:26 +00:00 |
|
|
Isotr0py
|
073c510c91
|
[Migration] Migrate bitsandbytes support to OOT plugin (#43529)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-09 10:27:31 +08:00 |
|
|
Andreas Karatzas
|
6e18901195
|
[Bugfix][MM] Avoid device sync in FusedInputNorm initialization (#51435)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 13:32:23 +08:00 |
|
|
Gyula ChinoradszkiandCursor Agent
|
d21fed9522
|
[Bugfix][models_multimodal] Remote HF python code misses importing class (#51427)
Signed-off-by: Gyula Chinoradszki <gchinora@amd.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-08-08 12:09:26 +08:00 |
|
|
music-dino
|
a828536fb5
|
[Bugfix][multi_modal] Fix pos_ids being unitialized for minicpmv2.6 in hf runner (#51432)
Signed-off-by: Dino Music <Dino.Music@amd.com>
|
2026-08-08 12:09:12 +08:00 |
|
|
Andreas Karatzas
|
12da9b23ae
|
[CI] Guard remote-code Transformers compatibility (#51451)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-08 12:05:49 +08:00 |
|
|
Woosuk Kwon
|
e644c8cd8c
|
[Perf] Optimize DeepSeek V3.2 sequence parallelism (#51434)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-07 16:51:01 -07:00 |
|
|
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
56a4b63d44
|
[K3 Perf] Optimize k3 dspark fused kv, 4.5~4.6x kernel performance improvement (#50585)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-07 12:16:11 -07:00 |
|
|
Harry Mellor
|
45273b8dcb
|
[1/N] Harden Transformers modelling backend multi-modal path (#51408)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-07 17:30:43 +00:00 |
|
|
kliuae
|
43d691ec6b
|
[ROCm][Perf] Kimi-K3 Shard Latent MoE up-projection for ROCm path (#51253)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
|
2026-08-07 06:11:18 +00:00 |
|
|
Taneem Ibrahim
|
9464529612
|
[ModelRunner v2] Enable decoder token-wise pooling (#50931)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-06 22:21:52 +00:00 |
|
|
Harry Mellor
|
e7b8d59460
|
Fully generalise input embedding handling in Transformers modelling backend (#51247)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-06 16:21:24 +00:00 |
|
|
Lyu Han
|
22013f74ff
|
Interns2mobius support (#51149)
Signed-off-by: Lyu Han <lvhan_028@163.com>
|
2026-08-06 10:39:35 +00:00 |
|
|
wang.yuqiandCyrus Leung
|
2fa490470d
|
[Model] Fused mm preprocess normalisation on the Device (#50411)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-06 03:11:14 -07:00 |
|
|
zofiaandopencode
|
febea17f6a
|
[Model] Fix weight prefix mapping for native Qwen3.5 text-only checkp… (#50355)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: opencode <opencode@anomaly.co>
|
2026-08-06 07:40:44 +00:00 |
|
|
Qiuyang Yue
|
777b01d1a8
|
[MM][CG] Support ViT full CUDA graph for Ernie-4.5-VL image inference (#45254)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-08-06 05:04:19 +00:00 |
|
|
Li JuqiandCyrus Leung
|
821717118f
|
[BugFix][Pooling] Skip weight-prefix probe when model has WeightsMapper (#50890)
Signed-off-by: Juqi Li <2223621784@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-05 21:12:33 -07:00 |
|
|
Yunzhu LuandCyrus Leung
|
f84df12c6a
|
[Bugfix][MM] Fix MiniCPM-V placeholder replacement and image processor loading on Transformers v5 (#48413)
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Signed-off-by: Yunzhu Lu <lucia.yunzhu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-05 21:12:00 -07:00 |
|
|
zexplorerhj
|
d4da0c55af
|
[Model][Frontend] Add Ling 3.0 Flash BF16, MTP, and parser support (#51045)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
|
2026-08-06 00:38:28 +08:00 |
|
|
music-dino
|
a9b39d6dcb
|
[Bugfix] Enable chunked prefill for qwen3.5-0.8B ppl test (#51153)
Signed-off-by: Dino Music <Dino.Music@amd.com>
|
2026-08-05 13:21:43 +00:00 |
|
|
TrainToGPBandClaude
|
eb3dce9757
|
[Bugfix][Model] Gemma3n/Gemma4: pad variable-length audio batches (#50958)
Signed-off-by: TrainToGPB <kaiba0514@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-05 12:46:00 +08:00 |
|
|
Michael Goin
|
9cd9f8c20b
|
Prune redundant tests points in correctness_e2e/[test_sequence_parallel,test_async_tp] (#51068)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-04 19:18:50 -07:00 |
|
|
Wentao Ye
|
d31de3c421
|
[Kimi K3 Perf] option to shard the shared expert for non mega case, 16.98 GiB memory/GPU saved (#50912)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-08-04 14:00:44 -04:00 |
|
|
|
7ac2ec7582
|
[Kimi-K3][AMD] Fuse AttnRes state updates and norms (#50593)
Signed-off-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: Liuyinfeng01 <199041580+LiuYinfeng01@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 12:32:13 -04:00 |
|
|
|
166f4e2dc3
|
fix: fuse weightless RMSNorms at their declared width (#50867)
Signed-off-by: Anuj Bolewar <anujbolewar@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Anuj Bolewar <anujbolewar@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-04 16:03:09 +00:00 |
|
|
Jiangyun Zhuandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f9c74b4b9c
|
[Mamba] enable prefix cache by default (#50991)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-04 15:20:51 +00:00 |
|
|
Harry Mellor
|
59b2fdfc4e
|
Support MLA properly in the Transformers modeling backend (#48250)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-04 13:24:11 +01:00 |
|
|
Lazurite
|
6a9fdf0dc7
|
[Bugfix] Resolve seq-cls num_labels from the top-level config for multimodal checkpoints (#50950)
Signed-off-by: Lazurite <43494437+Rapisurazurite@users.noreply.github.com>
|
2026-08-04 11:39:39 +00:00 |
|
|
fxmarty-amdandAndreas Karatzas
|
385d4c084e
|
[ROCm][AITER] Hotfix for memory access fault errors in AITER triton MOE routing (#50859)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-03 21:07:46 -05:00 |
|
|
Andreas Karatzas
|
8adc840c45
|
[ROCm][Test] Use BF16 for Jina v5 nano MTEB test (#50917)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-08-04 08:33:05 +08:00 |
|
|
Ryan HambyandIsotr0py
|
6a9109d865
|
[Bugfix] Fix Qwen3-Omni crash on video with no audio track when use_audio_in_video=True (#48420)
Signed-off-by: RyanJHamby <ryanhamby22@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-03 16:22:00 -07:00 |
|
|
|
5df9999fcf
|
[Kimi-K3] Add option to shard the shared expert instead of replicating (#50656)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-08-03 11:41:24 -04:00 |
|
|
wangxiyuan
|
dd11df04f3
|
[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
|
2026-08-03 11:15:13 -04:00 |
|
|
Kyungmin Leeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
9ae11a6b89
|
[Model] Add K-EXAONE-2.0-750B-A37B (#50524)
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-03 06:33:02 -07:00 |
|
|
wang.yuqi
|
9acb7b3699
|
[CI] And PPL test for multimodal generation models (#50839)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-03 11:25:08 +00:00 |
|
|
Omkar Shewale
|
9a4fd57cac
|
[Model] Support jina-embeddings-v5-text-nano (EuroBERT encoder backbone) (#50688)
Signed-off-by: Omkar Shewale <omkarshewale2001@gmail.com>
|
2026-08-03 01:37:08 +00:00 |
|
|
chun-wan
|
0033211c0b
|
[Test][V1] Add sleep/wake correctness regression test for hybrid GDN/… (#44972)
Signed-off-by: chun-wan <chun-wan@amd.com>
|
2026-08-02 22:02:42 +00:00 |
|
|
Taneem Ibrahim
|
55c98e370a
|
[Model Runner v2] Enable BGE M3 pooling embed token_classify (#50661)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-02 12:46:03 -04:00 |
|
|
Woosuk Kwon
|
38a466e7b6
|
[DSV4] Implement Sequence Parallelism (#46789)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-01 10:22:33 -07:00 |
|