iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
14,386 Commits 3 Branches 0 Tags
fa6a6be51978bd4b49ba0da17039e60f96dc5b13
Commit Graph
2340 Commits
Author SHA1 Message Date
xuebwang-amdRobert ShawRobert Shaw
 		b129136c7a [ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008) 
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-02-10 10:08:05 -05:00
tc-mbandVincent-Xiao e042d7e685 Add flagos in MiniCPM-o (#34126) 
Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Signed-off-by: Vincent-Xiao <vincent.xiao.me@gmail.com>
Co-authored-by: Vincent-Xiao <vincent.xiao.me@gmail.com>
 2026-02-10 02:51:48 -08:00
Roger Wang ae4e280602 [Bugfix] Fix FI kernelchunk_gated_delta_rule output shape for Qwen3.5 (#34219) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2026-02-10 10:41:24 +00:00
Roger Wang 047a457fa4 [Bugfix] Adopt ChunkGatedDeltaRule for Qwen3.5 (#34198) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2026-02-10 03:47:54 +00:00
Artus Krohn-Grimberghe 8fd31f6245 [Bugfix] Voxtral prompt/audio placeholder alignment (#34140) 
Signed-off-by: Artus KG <artuskg@gmail.com>
 2026-02-09 19:30:38 +00:00
Artus Krohn-Grimberghe eadb4e868b [Bugfix] Avoid duplicate k-proj weight emission in helper (#34142) 
Signed-off-by: Artus KG <artuskg@gmail.com>
 2026-02-09 19:17:44 +00:00
Jiangyun Zhu 285bab4752 [Kernel] use flashinfer for gdn prefill (#32846) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-02-09 12:17:25 -05:00
JJJYmmmwulipcywang96Isotr0pyIsotr0pyRoger Wang
 		9562912cea [MODEL] Adding Support for Qwen3.5 Models (#34110) 
Signed-off-by: JJJYmmm <1650675829@qq.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wulipc <wulipc@users.noreply.github.com>
Co-authored-by: ywang96 <ywang96@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-02-09 21:12:58 +08:00
Jee Jee Li 978a37c823 [Model] GLM adaptation (#34124) 2026-02-09 17:32:52 +08:00
Rohan Potdar de3869bb4d move checks out of unified_kv_cache_update custom op (#33943) 
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
 2026-02-07 05:30:09 -08:00
whx ce9b3cd3e9 [PluggableLayer][3/N] Apply PluggableLayer to mamba layers. (#33660) 
Signed-off-by: whx-sjtu <2952154980@qq.com>
 2026-02-07 05:26:05 -08:00
Jee Jee Li db4ede9743 [Model] Enable Step3p5ForCausalLM testing (#33755) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-02-07 05:25:24 -08:00
TundeAtSNandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 4df44c16ba Enable Eagle3 speculative decoding for Mistral3ForConditionalGeneration to support eagle3 (#33939) 
Signed-off-by: Akintunde Oladipo <akintunde.oladipo@servicenow.com>
Signed-off-by: TundeAtSN <akintunde.oladipo@servicenow.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-07 05:24:52 -08:00
Nicolò Lucchesi 55aeec04f5 [Bugfix] Fix Whisper tokenization (#34011) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-02-07 10:42:52 +08:00
tc-mbandmslv 4707f7ebb4 [Model] Support MiniCPM-o 4.5 (#33431) 
Signed-off-by: caitianchi <caitianchi@modelbest.cn>
Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Co-authored-by: mslv <mslv@baai.ac.cn>
 2026-02-06 15:29:10 +00:00
Raushan TurganbayCyrus LeungHarry Mellor
 		85ee1d962b [Bugfix] Fix models and tests for transformers v5 (#33977) 
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan.turganbay@alumni.nu.edu.kz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-06 21:47:41 +08:00
Kurt Shuster 2991dd3d22 [Bugfix][Model] Support LoRA on Qwen3 Output Embedding (#29816) 
Signed-off-by: kurt <kurt@thinkingmachines.ai>
 2026-02-06 20:25:31 +08:00
zhang-prog 233b26ab35 [PaddleOCR-VL] Add BC for transformers 5.0 config (#33976) 
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
 2026-02-06 10:33:49 +00:00
Xinyu Chen e969a169ef support view_from_cpu_tensor on XPU (#33868) 
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
 2026-02-06 08:34:20 +00:00
Harry Mellor 6d8d34be6d Fix main pre-commit (#33975) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-06 00:08:05 -08:00
chengchengpeiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 965525667b Onboard voyage-4-nano (#33720) 
Signed-off-by: Chengcheng Pei <chengchengpei@outlook.com>
Signed-off-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-06 06:23:34 +00:00
Cyrus Leung 116880a5a0 [Bugfix] Make MM batching more robust (#33817) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-05 20:40:58 +00:00
Isotr0py 87d0d17ab5 [Models] Consolidate Deepseek-OCR2 processor (#33909) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-05 18:29:20 +00:00
Benjamin Chislett af3162d3aa [Spec Decode] Unified Parallel Drafting (#32887) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
 2026-02-05 12:37:18 -05:00
Isotr0py a2522839d8 [Bugfix] Fix Kimi-K2.5 NVFP4 checkpoints weight loading (#33876) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-05 10:29:54 +00:00
Pavani Majety d2f4a71cd5 [Bugfix] Kimi-K2 grouped_topk usage for Flashinfer monolithic kernels. (#33858) 
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
 2026-02-05 09:32:10 +00:00
Ilya BoytsovCyrus Leungwang.yuqi
 		439afa4eea feat: Add ColBERT late interaction model support (#33686) 
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-02-05 08:05:13 +08:00
Sage MooreandRobert Shaw ce498a6d61 Change the type signature of MixtureOfExperts.expert_weights to MutableSequence[Sequence[Tensor]] (#33573) 
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-02-04 17:02:46 -05:00
Muhammad HashmiandNickLucche 535de06cb1 [Model] Add transcription support for Qwen3-Omni (#29828) 
Signed-off-by: Muhammad Hashmi <mhashmi@berkeley.edu>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
 2026-02-04 21:17:47 +00:00
Taeksang Kim 6e98f6d8b6 Implement zero-copy GQA for multimodal and CPU (#33732) 
Signed-off-by: Taeksang Kim <ts.kim@hyperaccel.ai>
 2026-02-04 20:11:39 +00:00
Isotr0py 192ad4648b [Bugfix] Fix interns1-pro initialization and PP (#33793) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-04 17:54:45 +00:00
Cyrus Leung e57ef99b40 [Model] Apply #32631 for recent models (#33785) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-04 12:23:01 +00:00
Yueqian LinandRoger Wang f8516a1ab9 [Bugfix][Model] Fix audio-in-video support for Qwen2.5-Omni and Qwen3-Omni (#33605) 
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-02-04 12:15:29 +00:00
Michael Goin eb5ed20743 [Bugfix] Define router_logits_dtype for remaining MoE models (#33737) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-02-04 13:24:14 +08:00
Shanshan Shen 9fb27dd3b3 [MM] Align the prefix of MMEncoderAttention with Attention (#33750) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2026-02-04 04:07:30 +00:00
Michael Goin 2a99c5a6c8 [Bugfix] Disable TRTLLM FP8 MoE if router_logits_dtype==float32 and routing_method!=DeepSeekV3 (#33613) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-02-03 13:26:51 -08:00
Patrick von PlatenandCyrus Leung f0d5251715 [Voxtral models] Skip warm-up to skip confusing error message in warm-up (#33576) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-03 07:22:34 -08:00
Shanshan Shen 5c4f2dd6ef [MM] Pass prefix parameter to MMEncoderAttention (#33674) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2026-02-03 06:47:41 -08:00
Harry Mellor 2a8d84e66d Fix Gemma3n audio encoder for Transformers v5 (#33673) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-03 05:49:49 -08:00
zxyandIsotr0py a3acfa1071 [Models] Intern-S1-Pro (#33636) 
Signed-off-by: zxy <zhou0493@e.ntu.edu.sg>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-03 05:49:45 -08:00
Song ZhixinandCyrus Leung ceab70c89d [Bugfix] fix qwen3-asr response error (#33644) 
Signed-off-by: jesse <szxfml@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-02-03 03:33:56 -08:00
Shengliang XuandCyrus Leung f1cb9b5544 Fix quantized Falcon-H1 model loading issues (#32728) 
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-02 22:31:27 -08:00
Patrick von Platenandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 5019c59dd2 [Voxtral Realtime] Introduce global log mel max (#33574) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-02 17:01:47 -05:00
Yang Liu 199e3cb476 [Model] Use mm_position to compute mrope positions for GLM-4.xV (#33039) 
Signed-off-by: Yang <lymailforjob@gmail.com>
 2026-02-02 16:55:48 +00:00
Isotr0py 4061dcf4c5 [Bugfix] Enable Kimi k25 processor test (#33562) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-02 14:25:25 +00:00
danielafrimi 0aca8b8c62 [MoE] Enable Shared/Routed Overlap For Latent MoE (Nemotron-H) (#32790) 
Signed-off-by: dafrimi <dafrimi@nvidia.com>
 2026-02-02 09:18:50 -05:00
Cyrus Leung b10d05b8a8 [Model] Use explicit types in get_generation_prompt (#33551) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-02 12:38:49 +00:00
Borushiki b398e5c819 Update get_expert_mapping to include self parameter (#33525) 
Signed-off-by: Borushiki <38628261+Otsutsukii@users.noreply.github.com>
 2026-02-02 20:29:07 +08:00
Grzegorz K. Karch 78061ef584 Fix accessing hidden_act from model config (#32686) 
Signed-off-by: Grzegorz Karch <gkarch@nvidia.com>
 2026-02-02 11:11:33 +00:00
REDliuliIsotr0py
 		808dd87b30 [Model] Support DeepSeek-OCR-2 (#33165) 
Signed-off-by: liuli <ll407707@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-02-02 06:24:10 +00:00