Commit Graph
3091 Commits
Author SHA1 Message Date
Cyrus Leung 040700aaa6 [MM] Address comments on #53275 (#53364)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-22 10:27:59 +00:00
Cyrus Leung 0b19ebcacd [MM] Simplify _apply_hf_processor_main (#53275)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-22 01:49:37 -07:00
Lucas Wilkinson 8bdc70ec7b [6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
2026-08-21 17:47:49 -07:00
Kevin H. LuuandAndreas Karatzas e3f6026503 Revert "Remove native Hunyuan V1 and VL implementations" (#53296)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
2026-08-21 13:39:58 -07:00
Tiezhen WANGandOpenAI Codex d53b1c2efc Remove native Hunyuan V1 and VL implementations (#53272)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
2026-08-21 09:07:10 -07:00
72aedcc426 [DCP] Default query replication for GLM sparse attention (#50382)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-21 09:07:05 -07:00
DCo c1d7a3808d [Bugfix] Fix HYV3 shared_mlp prefix for compressed-tensors ignore matching (#48682)
Signed-off-by: Xiaoyi Xu <xu_xiaoyi@hotmail.com>
2026-08-21 09:07:01 -07:00
linitra24 e85d1b69cf [Bugfix][LoRA] Use an explicit capability flag for tower connector LoRA (#53092)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
2026-08-21 09:45:54 +00:00
Zihan Zhang b389ac2946 [Spec Decode] DFlash2: local convolution + candidate selector (#52816) 2026-08-20 22:27:22 -07:00
Cyrus Leung b00f475f09 [MM] Remove text components from ProcessorInputs (#53093)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2026-08-20 20:42:53 -07:00
Kevin H. Luu d29f7f5c92 [Bugfix] Load untied Gemma LM head weights (#53170)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
2026-08-21 00:47:08 +00:00
Harry Mellor 1fe3a1571a Reduce AutoWeightsLoader kwargs (#53106)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 15:40:11 +00:00
Harry Mellor 2dd17225c6 Fix Transformers modelling backend RMSNormFuser.fuse performance (#52766)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 15:21:23 +00:00
Yiqinandshenyiqin cb09dd7488 [Core][Multimodal] Skip redundant placeholder scan when token match succeeds (#52925)
Co-authored-by: shenyiqin <shenyiqin1@huawei.com>
2026-08-20 15:04:29 +00:00
Zupeng Wang df1376907b [Model] Add tower and connector LoRA support for LFM2-VL (#51498)
Signed-off-by: zupengwang <71580390+zupengwang@users.noreply.github.com>
2026-08-20 20:33:43 +08:00
Harry Mellor f0c14b4f77 Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 10:31:55 +00:00
Harry Mellor 6e85feb1b7 [3/N] Harden Transformers modelling backend multi-modal path (#51827)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-20 10:24:41 +00:00
rongfu.lengandIsotr0py c8de519917 [Kernel][Kimi] fused vision q/k roper kernel (#50400)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
2026-08-20 09:15:47 +00:00
Juan Pérez de Algaba c0a25c089a [Bugfix][Security] Guard _load_ov2_processor with resolve_trust_remote_code (#52952)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-08-20 09:09:49 +00:00
EgorandClaude e9e1630e93 [Model] Support bidirectional (encoder-only) attention for DeepSeek e… (#52948)
Signed-off-by: Egor <erop001@gmail.com>
Signed-off-by: Egor <47443236+Lossfull@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-19 16:36:27 +00:00
Nave Assaf 58de6cbdc2 Add NemotronH_Omni_Reasoning_V3 as a supported Nemotron architecture (#52929)
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
2026-08-19 12:34:50 +00:00
hy123andOpenAI Codex b160cab156 [Bugfix] Restore model info caching for package backends (#52690)
Signed-off-by: haoyang.qian <haoyangqian@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-19 11:18:10 +00:00
wangxiyuan cba06764d7 [Platform] Fill in the missing backend parameter for torch.compile (#51781)
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
2026-08-19 10:31:19 +00:00
Woosuk Kwon b09bd69b5b [Model][NVIDIA] Route DSA models to the CUDA non-compiled path (#52861) 2026-08-19 00:13:52 -07:00
Nick Hill ee11730751 [BugFix] Revert incorrect MM keep_on_cpu=True changes (#52881)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-19 07:07:40 +00:00
5a4c8d9924 [Bugfix][LoRA] Add embedding_modules for Qwen3.5 CausalLM (#48850)
Signed-off-by: m0_68169237 <m0_68169237@noreply.gitcode.com>
Co-authored-by: m0_68169237 <m0_68169237@noreply.gitcode.com>
Co-authored-by: Cursor Composer <composer@cursor.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
2026-08-19 04:55:20 +00:00
3130573630 [Model] Add GraniteSWA and GraniteMoeSWA via existing Granite (#52706)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 20:32:46 -07:00
Nick Hill deeeae75d0 [MM] Keep more metadata tensors on CPU (#52827)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-18 19:56:33 -07:00
liuzhenwei b1d9337e92 [EPD] Allow KV consumers to omit MM embeddings (#52697)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
2026-08-19 02:16:08 +00:00
fxmarty-amd 88b2bff2c6 [MOE] Standardize and abstract fused shared expert optimization selection (#51695)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
2026-08-18 12:56:56 -04:00
f9f066d195 [Bugfix][PaliGemma] Remove stale image embedding scaling (#52692)
Signed-off-by: jikuixie <jikuixie@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-18 16:00:55 +00:00
karthik 241ff8c443 [Model] Enable LoRA support for tower and connector in LlavaNextForConditionalGeneration (#49788)
Signed-off-by: gangula-karthik <gkarthik923@gmail.com>
2026-08-18 15:53:49 +00:00
Komal Kumar TeruandCursor aa9903490c [Cohere] Misc changes to cohere model definitions (#50156)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-18 04:59:57 +00:00
Canlin GuoandNick Hill 455edc022b [ModelRunnerV2] Support prompt embeds (#42963)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: Canlin Guo <961750412@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-08-17 21:58:50 +00:00
Jiangyun ZhuOpenAI CodexBenjamin Chislettmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
70afdedc10 [K3] support recoverssm for K3 (#51855)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-17 19:34:14 +08:00
Chauncey 84530eb235 [Bugfix][Multimodal] Keep Gemma 4 video frame counts on CPU (#52441)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
2026-08-16 09:17:04 +00:00
Nick HillandClaude Opus 4.8 615d4cfade [Core] Check for GPU<->CPU syncs during CI (#43107)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-14 17:42:05 -07:00
Nick Hill 3e3ceb1961 [Perf] Avoid more GPU<->CPU syncs in multimodal encoders (#52369)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-08-14 10:40:14 -07:00
6adad08767 Add Muse Glimmer model support (#51655)
Signed-off-by: Tiezhen Wang <tiezhen@inferact.ai>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Beto de Paola <betodepaola@meta.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: zixi-qi <zixi@inferact.ai>
2026-08-14 12:28:56 +08:00
c05d75aaa9 [Bugfix][Refactor] Keep Qwen3Next layer boundaries sequence parallel (#50685)
Signed-off-by: kunzh <RimeK20@outlook.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
2026-08-14 11:58:32 +08:00
Harry Mellor b245d8e73f Apply logit softcapping in Transformers modelling backend (#52173)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-08-13 16:21:55 +00:00
Qiming Zhang 96acd473a7 [Bugfix][MiniCPM-V] Fix AssertionError in get_dummy_mm_data when passing VideoDummyOptions to _get_dummy_images (#52122)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
2026-08-13 15:44:03 +00:00
Harry MellorandClaude Opus 5 80d6d557f3 Standardise weight tying on ParallelLMHead.tie_weights (#52147)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-13 15:10:09 +00:00
95c9144424 [LoRA][Gemma4] Support vision tower LoRA (#42662)
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <joy25810@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: linitra24 <joy25810@gmail.com>
2026-08-13 22:07:43 +08:00
zexplorerhj 8e1131e1d1 [Model] [Quantization] Add Ling hybrid MXFP4 routed experts support (#52114)
Signed-off-by: zexplorerhj <zhjoneson@163.com>
2026-08-13 21:46:53 +08:00
Juan Pérez de Algaba 37c3bdf5a7 fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)
Signed-off-by: jperezde <jperezde@redhat.com>
2026-08-13 03:31:55 -07:00
Thomas Ortner b8baa31a28 Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
2026-08-13 11:21:50 +01:00
Li, Jiang 373592ef57 [CPU] Ship triton-cpu wheel and fix several hardcoded pin_memory=True (#52092)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
2026-08-13 14:40:53 +08:00
kiroxuandCodex 89c8401c8a [Model] Skip unused Jina V5 output layers (#52037)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
2026-08-13 06:14:37 +00:00
Yangyi GaoClaude Fable 5高杨懿OpenAI CodexOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
b908a21f9a [Model][LoRA] Add tower/connector LoRA support for Ultravox (#48215)
Signed-off-by: arthurgao2003 <arthurgao2003@gmail.com>
Signed-off-by: Arthur Gao <arthurgao2003@gmail.com>
Signed-off-by: 高杨懿 <15312196+gao-yangyi@user.noreply.gitee.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: 高杨懿 <15312196+gao-yangyi@user.noreply.gitee.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-12 22:57:59 -07:00