iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
13,168 Commits 3 Branches 0 Tags
019e2c3b7ca799e4497a67eb7e49edea361cb90e
Commit Graph
2125 Commits
Author SHA1 Message Date
Patrick von Platen 1579c9b5fd [Llama.py -> mistral.py] Extract mistral-only relevant code into separate file (#32780) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2026-01-22 05:14:57 +00:00
Xin Yang 63227accf5 [Kernel] Add topk_sigmoid kernel (#31246) 
Signed-off-by: Xin Yang <xyangx@amazon.com>
 2026-01-21 22:49:51 +00:00
Pleaplusone 6c20e89c02 [ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287) 
Signed-off-by: ganyi <ygan@amd.com>
 2026-01-21 23:16:30 +08:00
Robert ShawandRobert Shaw cea3c754c4 [Quantization][Deprecation] Remove DeepSpeedFp8 (#32679) 
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
 2026-01-21 09:32:12 -05:00
Robert Shaw 42135d6898 [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) 2026-01-21 08:22:33 -05:00
Divakar Verma e14467be43 [bugfix] Aria model (#32727) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
 2026-01-21 05:11:31 -08:00
Kim Hee Su 7727ce35c2 [Model] Add Eagle2.5-8B Vision-Language Model support (#32456) 
Signed-off-by: kimheesu <wlskaka4@gmail.com>
 2026-01-21 09:39:53 +00:00
RickyChen / 陳昭儒 f23fb5a7c1 [Bugfix] Support HF sharded weights for Mistral3/Pixtral models (#32673) 
Signed-off-by: ricky-chaoju <ricky.chen@infinirc.com>
Signed-off-by: vllm-dev <ricky.chen@infinirc.com>
 2026-01-20 23:27:30 -08:00
Netanel Haber 27ca95b3c9 [Bugfix] Fix Nemotron-Nano-v2-vlm static resolution (#32682) 
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
 2026-01-21 06:28:21 +00:00
shanjiaz 7ab80a8e37 Added qwen3 vision language moe support for speculative decoding (#32048) 
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <43143795+shanjiaz@users.noreply.github.com>
 2026-01-21 03:24:05 +00:00
gopalsarda 0900cedb3f Enable Eagle3 speculative decoding for Pixtral (LlavaForConditionalGeneration) (#32542) 
Signed-off-by: gopalsarda <gopal.sarda@servicenow.com>
 2026-01-21 11:18:05 +08:00
Alex Brooks 27b81e010d [Bugfix] Fix Granite Vision / Don't use Siglip Pooling Head Nested Models by Default (#32299) 
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2026-01-21 11:11:52 +08:00
Cyrus Leung 193069d129 [5/N] Initialize MM components in context managers (Q-Z) (#32695) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 19:10:23 +00:00
JJJYmmm 04a9e064db [Bugfix] fix the ima issue of qwen-vit (#32687) 
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
 2026-01-20 17:21:25 +00:00
Cyrus Leung fda3f03eb2 [4/N] Initialize MM components in context managers (M-P) (#32663) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 14:06:32 +00:00
Chauncey c4e5bdf61b [Bugfix] Fix the fp8_mqa_logits dim mismatch (#32652) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-20 18:48:07 +08:00
Cyrus Leung 7f1bcd18ff [3/N] Initialize MM components in context managers (I-L) (#32650) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 10:21:56 +00:00
Cyrus Leung e1a34c3a5d [2/N] Initialize MM components in context managers (E-H) (#32641) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 08:12:56 +00:00
Cyrus Leung b75e85dede [1/N] Initialize MM components in context managers (A-D) (#32632) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 14:12:42 +08:00
Cyrus Leung 4753f3bf69 [Model] Use context managers for encoder- and LM-only mode (#32605) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 11:43:38 +08:00
Netanel Haber cd3ac5b797 support dynamic resolution image encoding for Nemotron Nano VL (#32121) 
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
 2026-01-19 18:15:58 +00:00
Jee Jee Li 2636d76257 [Misc] Remove unused ModelKeys (#32608) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-01-19 17:34:59 +00:00
danisereb aa7f37ccfa Add support for LoRA adapters in Nemotron-H models (#30802) 
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
 2026-01-19 22:30:44 +08:00
Nicolò Lucchesi 74c583bc50 [Core] Whisper support torch.compile (#30385) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-01-19 10:02:31 +00:00
Yuxuan Zhang 71832ba71e [GLM-4.7] GLM Model support for GLM-Lite (#31386) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Yuxuan Zhang <2448370773@qq.com>
 2026-01-19 01:18:38 -08:00
honglyua 976af2f314 [BugFix] Fix embed_input_ids argument error of QwenVLForConditionalGeneration (#32462) 2026-01-19 03:06:02 +00:00
bnellnm 327a02d8db [MoE Refactor] Separate Router into OO Classes (#30623) 
Signed-off-by: Bill Nell <bnell@redhat.com>
 2026-01-18 11:40:49 -05:00
tjp_zjuandWentao Ye 2f03035a61 "refactor: refactor_repeated_interfaces" (#32486) 
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-01-18 22:07:01 +08:00
Isotr0py 38bf2ffb21 [Bugfix] Fix GLM-ASR audio encoder RoPE dim (#32540) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-01-18 19:17:59 +08:00
Li Xie c826c72a96 [Model] Support Step1 Model (#32511) 
Signed-off-by: xieli <xieli@stepfun.com>
 2026-01-18 10:20:46 +00:00
Canlin Guo fe36bf5e80 [Model] Remove the unnecessary dtype conversion in MiniCPM (#32523) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
 2026-01-18 08:07:28 +00:00
Kim Hee Su 1646fea672 [Model] Molmo2: Enable quantized weight mapping for vision backbone (#32385) 
Signed-off-by: kimheesu <wlskaka4@gmail.com>
 2026-01-17 09:33:05 +00:00
Paul Pak d3317bbba4 [Models] Lfm2Moe: minor name changes for resolving lora conflicts (#29063) 
Signed-off-by: Paul Pak <paulpak58@gmail.com>
 2026-01-16 22:12:55 -08:00
Cyrus Leung 180e981d56 [Chore] Replace swish with silu (#32459) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-16 08:22:45 +00:00
KebeandLucas Wilkinson 5de6dd0662 [Bugfix] [DeepSeek-V3.2] fix sparse_attn_indexer padding (#32175) 
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-01-16 03:21:55 +00:00
ltd0924luotingdanCyrus LeungRoger Wang
 		709502558c [Model] Add Step3vl 10b (#32329) 
Signed-off-by: luotingdan <luotingdan@stepfun.com>
Signed-off-by: ltd0924 <32387785+ltd0924@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-01-15 19:04:16 -08:00
Cyrus Leung cdba4c74b3 [Model] Avoid token selection in SigLIP pooling head (#32389) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-15 17:01:59 +08:00
Cyrus Leung 9ea07b41da [1/N] Reorganize multimodal processing code (#32327) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-14 15:25:31 +00:00
Roger Wang b8199f6049 [Model] Re-implement Qwen3Omni Audio Encoder (#32167) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2026-01-14 15:40:30 +08:00
sangho.leeandIsotr0py 7e6f123810 Add Molmo2 multimodal model support (#30997) 
Signed-off-by: sanghol <sanghol@allenai.org>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-01-14 15:33:09 +08:00
Matthew Bonanni 98f60e5acb [6/N][Attention] Move utils to more appropriate locations (#32215) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-01-13 05:38:52 -08:00
Cyrus Leung 232214b2ae [Bugfix] Replace PoolingParams.normalize with use_activation (#32243) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-13 10:45:42 +00:00
Cyrus Leung eb28e8068d [Refactor] Remove get_encoder_dummy_data (#32241) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-13 09:21:23 +00:00
YunzhuLuandIsotr0py 542a4059b2 [Model] Use mm_position to compute mrope positions for Qwen2-VL/2.5-VL (#32126) 
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-01-13 09:04:29 +00:00
Andreas Karatzas 11b6af5280 [ROCm][Bugfix] Fix Mamba batched decode producing incorrect output (#32099) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-01-13 05:46:53 +00:00
Cyrus Leung 78d13ea9de [Model] Handle trust_remote_code for transformers backend (#32194) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-13 09:30:12 +08:00
Vadim Gimpelson 9f430c94bd [BUGFIX] Add missed remaping of the names of fp8 kv-scale (#32199) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
 2026-01-12 20:42:06 +00:00
Roger Wang 16abe6b85a [Misc] Set default torch num threads for input processing (#31879) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2026-01-12 10:28:16 -08:00
Kyungmin Lee 3d962d72ab [BugFix] fix FusedMoE.make_expert_params_mapping in EXAONE-MoE (#32196) 
Signed-off-by: lkm2835 <lkm2835@gmail.com>
 2026-01-12 10:00:45 -08:00
Matthew Bonanni 20228cb851 [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-01-12 09:13:56 -08:00