Commit Graph
1479 Commits
Author SHA1 Message Date
Harry Mellor 1fe3a1571a Reduce AutoWeightsLoader kwargs (#53106)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 15:40:11 +00:00
Harry Mellor 2dd17225c6 Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 15:21:23 +00:00
Harry Mellor f0c14b4f77 Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 10:31:55 +00:00
Harry Mellor 6e85feb1b7 [3/N] Harden Transformers modelling backend multi-modal path (#51827)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 10:24:41 +00:00
Andreas Karatzas 4f66bc3e0d [CI][ROCm] Standardize AMD test job labels by device (#52976)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
2026-08-19 22:33:25 -05:00
EgorandClaude e9e1630e93 [Model] Support bidirectional (encoder-only) attention for DeepSeek e… (#52948)
Signed-off-by: Egor <erop001@gmail.com>
Signed-off-by: Egor <47443236+Lossfull@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-19 16:36:27 +00:00
Nave Assaf 58de6cbdc2 Add NemotronH_Omni_Reasoning_V3 as a supported Nemotron architecture (#52929)
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
2026-08-19 12:34:50 +00:00
hy123andOpenAI Codex b160cab156 [Bugfix] Restore model info caching for package backends (#52690)
Signed-off-by: haoyang.qian <haoyangqian@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 11:18:10 +00:00
Woosuk Kwon b09bd69b5b [Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861) 2026-08-19 00:13:52 -07:00
Taneem Ibrahim 08afae2786 [ModelRunner v2] Enable MRV2 for pooling models by default (#48290)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-18 21:36:05 -07:00
3130573630 [Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 20:32:46 -07:00
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 a9f4afb66f [Bugfix] Fix DeepSeek V4 mHC broadcast buffer for dummy load (#51368)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
2026-08-18 17:02:18 -07:00
Matvei PashkovskiiandClaude ad5e71b276 [ROCm][Perf] Enable fused KDA decode on gfx942 (MI325X) (#52293)
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-18 18:01:00 +00:00
Qiming ZhangandKunshang Ji f4b161d7fc [XPU][UT] Fix OOM and skip graph case (#49287)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
2026-08-18 09:47:35 +08:00
stefankoncarevicandAndreas Karatzas 402547d7f0 [Bugfix][CI] Release the shared ColBERT engine before test_colbert_hf_comparison (#52608)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-17 17:50:26 +00:00
Jiangyun ZhuOpenAI CodexBenjamin Chislettmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
70afdedc10 [K3] support recoverssm for K3 (#51855)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-17 19:34:14 +08:00
pmanczak cc7cf71fc8 [XPU] Enable Kimi K3 KDA kernel tests on XPU (#51809)
Signed-off-by: pmanczak <pawel.manczak@intel.com>
2026-08-17 17:21:34 +08:00
Isotr0py 5fd7a88838 [CI/Build] Fix accident pre-commit breakage due to concurrent merge (#52578)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-08-17 06:40:36 +00:00
Isotr0py 53e211d292 [CI/Build] Reduce more duplicate runner startup in tests (#52570)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-08-17 05:19:07 +00:00
Andreas Karatzas 311b3513af [ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test (#52565)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
2026-08-16 23:08:35 -05:00
Shanshan ShenandAndreas Karatzas 0ad04cff1b [ROCm][CI] Enable ViT CUDA graph tests on AMD gfx950 GPUs (#52256)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-17 09:52:02 +08:00
Isotr0py e3c1cb54fc [CI/Build] Avoid duplicate runner startup for multimodal test (#52417)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-08-16 22:17:25 +00:00
Taneem Ibrahim fdab2b10bc [ModelRunner v2] Support Transformers pooling model (#52425)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
2026-08-16 15:25:49 -04:00
Taneem IbrahimandWentao Ye 1f0e0bf612 [Bugfix][Attention] Temporarily disable FA4 head-dim 256 (#52050)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
2026-08-16 17:13:02 +00:00
Chauncey 84530eb235 [Bugfix][Multimodal] Keep Gemma 4 video frame counts on CPU (#52441)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
2026-08-16 09:17:04 +00:00
Nick HillandClaude Opus 4.8 615d4cfade [Core] Check for GPU<->CPU syncs during CI (#43107)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-14 17:42:05 -07:00
Rahul ChalamalaandJanelle Cai 03a8d0b1ed [Model][Spec Decode] Tap the pre-norm AttnRes mixture as the Kimi K3 DFlash aux state (#50487)
Signed-off-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Janelle Cai <janelle.cai@modal.com>
2026-08-14 09:03:42 -07:00
Jee Jee Li 69e0e58da1 [Doc] Update model support information (#52289)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
2026-08-14 09:47:30 +00:00
bastefaniak 20405bfb15 [Bugfix] Fix Cosmos3-Edge processor after transformers 5.15 release (#51989)
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
2026-08-14 10:46:46 +01:00
6adad08767 Add Muse Glimmer model support (#51655)
Signed-off-by: Tiezhen Wang <tiezhen@inferact.ai>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Beto de Paola <betodepaola@meta.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: zixi-qi <zixi@inferact.ai>
2026-08-14 12:28:56 +08:00
Nick Iusiumbeli 83d4c6196a [Bugfix] Declare SupportsEagle3 on KimiLinearForCausalLM (#52171)
Signed-off-by: Nick Iusiumbeli <nickuspro@gmail.com>
2026-08-13 16:22:50 +00:00
Thien Tran 6014f9e672 [Kimi-K3] Add GEMM-RS for sequence parallelism (#52079)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
2026-08-13 09:02:28 -07:00
Juan Pérez de Algaba 37c3bdf5a7 fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-08-13 03:31:55 -07:00
Thomas Ortner b8baa31a28 Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
2026-08-13 11:21:50 +01:00
Yongye ZhuClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
903d2efe7e [Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-12 22:42:57 -07:00
Kevin H. LuuandOpenAI Codex 8eb35c5217 [CI] Mirror external test assets in vLLM S3 (#52064)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-13 02:08:59 +00:00
9035151d6c [Model] Add native Dots3 NOTE multimodal support (#51255)
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-08-12 23:13:20 +08:00
aoshen02 4eef91c03c [Model] Support R3 capture with DeepGEMM MegaMoE (#51831)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
2026-08-12 01:07:07 -07:00
7f9173dfa2 [ROCm][Perf] Kimi-K3 Fused kernel for KDA decode (#50654)
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
2026-08-11 20:39:34 -07:00
Andreas KaratzasandOpenAI Codex 1ab2801dde [ROCm] Remove stale SDPA and skinny GEMM workarounds (#50907)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-11 14:19:16 -04:00
Harry Mellor 9cc347ae42 Enable MiniCPMV for vLLM in CI (#45042)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-11 16:30:39 +00:00
Harry Mellor c65aa2ee6c Bump Transformers version to 5.15.0 (#51668)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-11 09:00:51 -07:00
Roberto L. CastroLucas Wilkinsonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
6c95a641e9 [2/N][Feat][Perf] Add new warmup infrastructure for JITs. Add predicate filtering for JIT warmup, and migrate Inkling FA4 (#49315)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-11 07:46:07 -04:00
Khushali Desaiandwang.yuqi dc5101fb1b replace batch_norm to numerically identical without cudnn (#51734)
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
2026-08-11 12:43:20 +08:00
Almog Tavor c3cac8c63d [Bugfix][MiMo] Apply vision attention sinks in the window attention path (#49815)
Signed-off-by: almogtavor <almogtavor@gmail.com>
2026-08-10 22:36:42 +00:00
Lyu, Xudong 0e2d78028c [Bugfix][Kimi-K3] Give the AMD packed KDA decode kernel the state-index stride (#51682)
Signed-off-by: Lyu, Xudong <xudong.lyu@amd.com>
2026-08-11 00:05:20 +08:00
Harry Mellor cf8f3a3bb2 [2/N] Harden Transformers modelling backend multi-modal path (#51657)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-10 12:57:12 +00:00
efschu 900d09f91a [Bugfix][Model] Fix Qwen3.5 MTP for text-only checkpoints (#50734)
Signed-off-by: efschu <51944948+efschu@users.noreply.github.com>
2026-08-10 11:04:53 +00:00
Harry Mellor 70b84f0bcb Fix Gemma 4 for upcoming Transformers version (#49797)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-10 07:48:26 +00:00
Isotr0py 073c510c91 [Migration] Migrate bitsandbytes support to OOT plugin (#43529)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
2026-08-09 10:27:31 +08:00