iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
33d51f599e414c3639bdea7e5e8fb0c7bb61cc3d
vLLM/vllm/model_executor/models
T
History
Woosuk KwonandRoger Wang 2c5302fadd [Multimodal] Optimize Qwen2/2.5-VL startup time (#19756) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
2025-06-21 20:01:07 +00:00
..
__init__.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
adapters.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
aimv2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
arctic.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
aria.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
aya_vision.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
baichuan.py
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
bamba.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
bart.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
bert_with_rope.py
[CI] Add mteb testing for rerank models (#19344)
2025-06-16 01:36:43 -07:00
bert.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
blip2.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
blip.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
bloom.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
chameleon.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
chatglm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
clip.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
commandr.py
[Model] use AutoWeightsLoader for commandr (#19399)
2025-06-10 22:42:21 +00:00
constant_size_cache.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
dbrx.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
deepseek_mtp.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
deepseek_v2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
deepseek_vl2.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
deepseek.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
eagle.py
[Bugfix][2/n] Fix speculative decoding CI - Fix test_ngram_e2e_greedy_correctness (#19644)
2025-06-14 21:15:41 -07:00
exaone.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
fairseq2_llama.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
falcon_h1.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
falcon.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
florence2.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
fuyu.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
gemma2.py
Mark invariant normalizer in Gemma as non-persistent (#19788)
2025-06-18 22:56:03 -07:00
gemma3_mm.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
gemma3.py
Mark invariant normalizer in Gemma as non-persistent (#19788)
2025-06-18 22:56:03 -07:00
gemma.py
Mark invariant normalizer in Gemma as non-persistent (#19788)
2025-06-18 22:56:03 -07:00
glm4.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
glm4v.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
glm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
gpt2.py
[Model] GPT2ForSequenceClassification model (#19663)
2025-06-20 12:07:41 +00:00
gpt_bigcode.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
gpt_j.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
gpt_neox.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
granite_speech.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
granite.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
granitemoe.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
granitemoehybrid.py
[Feature]:Allow for Granite MoE Hybrid models with _only_ shared experts. (#19652)
2025-06-16 11:14:18 +00:00
granitemoeshared.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
gritlm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
grok1.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
h2ovl.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
idefics2_vision_model.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
idefics3.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
interfaces_base.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
interfaces.py
[V1] Change return type on get_multimodal_embeddings() (#19446)
2025-06-16 13:32:15 -04:00
intern_vit.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
internlm2_ve.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
internlm2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
internvl.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
jais.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
jamba.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
kimi_vl.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
llama4.py
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
llama_eagle3.py
[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033)
2025-06-05 19:10:08 -07:00
llama_eagle.py
[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033)
2025-06-05 19:10:08 -07:00
llama.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
llava_next_video.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
llava_next.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
llava_onevision.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
llava.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
mamba2.py
[v1] Support mamba2 (#19327)
2025-06-18 20:34:15 +00:00
mamba_cache.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
mamba.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
medusa.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
mimo_mtp.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
mimo.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
minicpm3.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
minicpm_eagle.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
minicpm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
minicpmo.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
minicpmv.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
minimax_cache.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
minimax_text_01.py
[Model] Fix minimax model cache & lm_head precision (#19592)
2025-06-13 12:08:20 +00:00
minimax_vl_01.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
mistral3.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
mixtral_quant.py
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
mixtral.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
mllama4.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
mllama.py
[Bugfix] Update multimodel models mapping to fit new checkpoint after Transformers v4.52 (#19151)
2025-06-17 15:58:38 +00:00
mlp_speculator.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
modernbert.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
module_mapping.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
molmo.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
moonvit.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
mpt.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
nemotron_h.py
[Model] Optimize nemotron_h implementation (#19249)
2025-06-06 10:05:14 +00:00
nemotron_nas.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
nemotron.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
nvlm_d.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
olmo2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
olmo.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
olmoe.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
opt.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
orion.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
ovis.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
paligemma.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
persimmon.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
phi3_small.py
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
phi3.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
phi3v.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
phi4mm_audio.py
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
phi4mm_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
phi4mm.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
phi.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
phimoe.py
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
pixtral.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
plamo2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prithvi_geospatial_mae.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
qwen2_5_omni_thinker.py
[Bugfix] Fix the linter (#19826)
2025-06-18 21:44:41 -07:00
qwen2_5_vl.py
[Bugfix] Fix the linter (#19826)
2025-06-18 21:44:41 -07:00
qwen2_audio.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
qwen2_moe.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
qwen2_rm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
qwen2_vl.py
[Multimodal] Optimize Qwen2/2.5-VL startup time (#19756)
2025-06-21 20:01:07 +00:00
qwen2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
qwen3_moe.py
[Chore]: qwen3-moe-type-hints-mistake (#19860)
2025-06-19 21:43:07 -07:00
qwen3.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
qwen_vl.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
qwen.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
registry.py
[New model support]Support Tarsier2 (#19887)
2025-06-21 04:01:51 +00:00
roberta.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
siglip.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
skyworkr1v.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
smolvlm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
solar.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
stablelm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
starcoder2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tarsier.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
telechat2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
teleflm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
ultravox.py
[Core] More fixes to MultiModalEmbeddings type handling (#19715)
2025-06-18 22:48:29 +00:00
utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
vision.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
whisper.py
[V1] Change return type on get_multimodal_embeddings() (#19446)
2025-06-16 13:32:15 -04:00
zamba2.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00