iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
7,797 Commits 3 Branches 0 Tags
4adc66f64d56338489d00d94de6e13d95741c4be
Commit Graph
114 Commits
Author SHA1 Message Date
Harry Mellor a931b4cdcf Remove Qwen Omni workaround that's no longer necessary (#21057) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-16 16:25:23 +00:00
Cyrus Leung 1c3198b6c4 [Model] Consolidate pooler implementations (#20927) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-16 13:39:13 +00:00
Wang Siyuan 247102f07f [Bugfix] Fix: add patch_rope_scaling after hf override (#20857) 
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
 2025-07-13 00:13:25 -07:00
Patrick von Platen 14601f5fba [Config] Refactor mistral configs (#20570) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2025-07-07 15:25:10 -07:00
Cyrus Leung c18b3b8e8b [Bugfix] Add use_cross_encoder flag to use correct activation in ClassifierPooler (#20527) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 14:01:48 -07:00
Seiji Eicher 8d1096e7db [Bugfix] Register reducer even if transformers_modules not available (#19510) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
 2025-07-03 22:08:12 +00:00
Isotr0py 71d6de3a26 [Misc] Clean up InternVL family config registration (#19992) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-03 20:01:47 +00:00
rongfu.leng 139508a418 [Misc] add handler HF_TOKEN is emptry string (#20369) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-07-02 09:14:31 -07:00
Li WangandJee Jee Li 1efef71645 [Bugfix] Fix modelscope token passed in (#19389) 
Signed-off-by: wangli <wangli858794774@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-06-10 13:39:37 +08:00
wang.yuqi 2ffb9b6e07 [Bugfix] model_max_length should consider max_model_len in tokenizer_config (#19201) 2025-06-08 07:17:53 -07:00
Simon Mo 02f0c7b220 [Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Cyrus Leung 6aa8f9a4e7 [Core] Rework dtype resolution (#18751) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-01 11:04:23 +08:00
Maximilien de BayserandCyrus Leung 515b413ebf Prevent the cross-encoder logic from being applied to classification tasks (#18838) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-28 19:16:17 -07:00
Mengqing CaoandIsotr0py 6ab681bcbe [Misc][ModelScope] Change to use runtime VLLM_USE_MODELSCOPE (#18655) 
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-05-25 04:51:21 +00:00
Mathieu Borderé 45ab403a1f config.py: Clarify that only local GGUF checkpoints are supported. (#18623) 
Signed-off-by: Mathieu Bordere <mathieu@letmetweakit.com>
 2025-05-24 08:46:34 +08:00
汪志鹏tracelogfbStephen Chen
 		4ee4826ede [BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>
 2025-05-17 04:20:13 +00:00
Harry Mellor 8c946cecca Update deprecated type hinting in vllm/transformers_utils (#18058) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-13 04:34:37 -07:00
MarcoIsotr0pyIsotr0py
 		54072f315f [MODEL ADDITION] Ovis2 Model Addition (#15826) 
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-04-30 07:33:29 +00:00
qscqesze cde384cd92 [Model] support MiniMax-VL-01 model (#16328) 
Signed-off-by: qingjun <qingjun@minimaxi.com>
 2025-04-29 12:05:50 +08:00
Harry Mellor 423e9f1cbe Use Transformers helper get_text_config() instead of checking for text_config (#17105) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-04-25 08:47:35 -07:00
Michael Goin 9420a1fc30 Better error message for missing mistral params.json (#17132) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-24 23:43:08 +00:00
Isotr0py b0c1f6202d [Misc] Remove OLMo2 config copy (#17066) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-04-24 06:14:32 -07:00
Michael Goin aa72d9a4ea Mistral-format support for compressed-tensors (#16803) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-23 08:46:23 -04:00
Yang FanRoger WangRoger WangXiong Wang
 		2c1bd848a6 [Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) 
Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>
 2025-04-18 23:14:36 -07:00
courage17340 b1308b84a3 [Model][VLM] Add Kimi-VL model support (#16387) 
Signed-off-by: courage17340 <courage17340@163.com>
 2025-04-14 21:41:48 +00:00
paolovicandpaolovic da224daaa9 [Bugfix] add hf_token to EngineArgs (#16093) 
Signed-off-by: paolovic <paul-philipp.luley@uzh.ch>
Co-authored-by: paolovic <paul-philipp.luley@uzh.ch>
 2025-04-06 14:47:33 +00:00
yihong 37bfee92bf fix: better error message for get_config close #13889 (#15943) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-04-03 03:53:19 +00:00
pengyuangeandjiacai.liu de1cb38769 [Model] Support Skywork-R1V (#15397) 
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
 2025-03-28 20:39:21 -07:00
Chen1022 340e39e387 Fix string parsing error (#13825) 2025-02-25 08:20:29 -08:00
Chen1022andMichael Goin 32c3b6bfd1 [Misc]Clarify Error Handling for Non-existent Model Paths and HF Repo IDs (#13724) 
Signed-off-by: Chen-0210 <chenjincong11@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-02-25 10:12:19 +00:00
Isotr0py 550d97eb58 [Misc] Avoid calling unnecessary hf_list_repo_files for local model path (#13348) 
Signed-off-by: isotr0py <2037008807@qq.com>
 2025-02-19 18:57:48 +00:00
Kevin H. LuuandEC2 Default User d5d214ac7f [1/n][CI] Load models in CI from S3 instead of HF (#13205) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 07:34:59 +00:00
Isotr0py 29fc5772c4 [Bugfix] Remove noisy error logging during local model loading (#13458) 2025-02-18 03:15:48 -08:00
r.4ntix ce77eb9410 [Bugfix] Fix VLLM_USE_MODELSCOPE issue (#13384) 2025-02-17 14:22:01 +00:00
Maximilien de Bayser 7c4033acd4 Further reduce the HTTP calls to huggingface.co (#13107) 2025-02-12 02:34:09 -08:00
Kevin H. Luu fde71262e0 [misc] Add retries with exponential backoff for HF file existence check (#13008) 2025-02-10 01:15:02 -08:00
Patrick von Platenandmgoin d366ccc4e3 [RFC] [Mistral] FP8 format (#10130) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2025-02-08 14:12:53 -07:00
Maximilien de Bayser 6e1fc61f0f Prevent unecessary requests to huggingface hub (#12837) 2025-02-06 21:37:41 -08:00
Kevin H. LuuandEC2 Default User e152f29502 [misc] Reduce number of config file requests to HuggingFace (#12797) 
Signed-off-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-06 14:59:18 +00:00
Russell Bryant e489ad7a21 [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 
- **Add SPDX license headers to python source files**
- **Check for SPDX headers using pre-commit**

commit 9d7ef44c3cfb72ca4c32e1c677d99259d10d4745
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:18:24 2025 -0500

    Add SPDX license headers to python source files
    
This commit adds SPDX license headers to python source files as
recommended to
the project by the Linux Foundation. These headers provide a concise way
that is
both human and machine readable for communicating license information
for each
source file. It helps avoid any ambiguity about the license of the code
and can
    also be easily used by tools to help manage license compliance.
    
The Linux Foundation runs license scans against the codebase to help
ensure
    we are in compliance with the licenses of the code we use, including
dependencies. Having these headers in place helps that tool do its job.
    
    More information can be found on the SPDX site:
    
    - https://spdx.dev/learn/handling-license-info/
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

commit 5a1cf1cb3b80759131c73f6a9dddebccac039dea
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:36:32 2025 -0500

    Check for SPDX headers using pre-commit
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

---------

Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-02 11:58:18 -08:00
Roger Wang 7a8987dac5 [Bugfix] Gracefully handle huggingface hub http error (#12571) 2025-01-31 08:19:35 +00:00
Cyrus Leung b37d82791e [Model] Upgrade Aria to transformers 4.48 (#12203) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-20 17:58:48 +08:00
Cyrus Leung 630eb5b5ce [Bugfix] Fix multi-modal processors for transformers 4.48 (#12187) 2025-01-18 19:16:34 -08:00
Isotr0pyandCyrus Leung f967e51f38 [Model] Initialize support for Deepseek-VL2 models (#11578) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-01-12 00:17:24 -08:00
youkaichao 328841d002 [bugfix] interleaving sliding window for cohere2 model (#11583) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-12-28 16:55:42 +00:00
Flávia Béo 250ee65d72 [BUG] Remove token param #10921 (#11022) 
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
 2024-12-10 17:38:15 +00:00
shunxing12345xiangw2Isotr0py
 		1209261e93 [Model] Support telechat2 (#10311) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: xiangw2 <xiangw2@chinatelecom.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2024-11-27 11:32:35 +00:00
Shane A 9db713a1dc [Model] Add OLMo November 2024 model (#10503) 2024-11-25 17:26:40 -05:00
Maximilien de BayserandFlavia Beo 214efc2c3c Support Cross encoder models (#10400) 
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
 2024-11-24 18:56:20 -08:00
Cyrus Leung 09dbf9ff16 [Bugfix] Handle conflicts between modern and legacy fields (#10471) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2024-11-20 14:45:08 +08:00