vLLM/vllm/model_executor/models at 334d64d1e816cc7c9fa2f67e22d24638e63c8e15 - vLLM

__init__.py

[Model] Molmo vLLM Integration (#9016 )

2024-10-14 07:56:24 -07:00

arctic.py

[model][utils] add extract_layer_index utility function (#10599 )

2024-11-23 22:22:54 -08:00

aria.py

[bugfix] fix aria model and add torch.compile (#10645 )

2024-11-25 18:32:09 -08:00

baichuan.py

[Model] Fix Baichuan BNB online quantization (#10572 )

2024-11-22 21:13:59 -08:00

bart.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

bert.py

[Model] Enable optional prefix when loading embedding models (#10639 )

2024-11-25 18:14:33 +00:00

blip2.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

blip.py

[Model] Remove transformers attention porting in VITs (#10414 )

2024-11-18 21:45:21 +08:00

bloom.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

chameleon.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

chatglm.py

[Bugfix] Fix LoRA weight sharding (#10450 )

2024-11-23 17:23:17 -08:00

clip.py

[Model] Add Support for Multimodal Granite Models (#10291 )

2024-11-21 10:46:20 +00:00

commandr.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

dbrx.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

decilm.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

deepseek_v2.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

deepseek.py

[model][utils] add extract_layer_index utility function (#10599 )

2024-11-23 22:22:54 -08:00

eagle.py

[V1] Refactor model executable interface for all text-only language models (#10374 )

2024-11-17 05:18:46 +00:00

exaone.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

falcon.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

florence2.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

fuyu.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

gemma2.py

[Model] Enable optional prefix when loading embedding models (#10639 )

2024-11-25 18:14:33 +00:00

gemma.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

glm4_vision_encoder.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

gpt2.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

gpt_bigcode.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

gpt_j.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

gpt_neox.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

granite.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

granitemoe.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

h2ovl.py

[1/N] Initial prototype for multi-modal processor (#10044 )

2024-11-13 12:39:03 +00:00

idefics2_vision_model.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

idefics3.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

interfaces_base.py

[Misc] Remove outdated init protocols (#10655 )

2024-11-26 14:55:00 +08:00

interfaces.py

[Misc] Remove outdated init protocols (#10655 )

2024-11-26 14:55:00 +08:00

intern_vit.py

[Model] Remove transformers attention porting in VITs (#10414 )

2024-11-18 21:45:21 +08:00

internlm2_ve.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

internlm2.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

internvl.py

[Model] Expose dynamic_image_size as mm_processor_kwargs for InternVL2 models (#10518 )

2024-11-21 14:20:08 +00:00

jais.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

jamba.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

llama.py

[bugfix] fix aria model and add torch.compile (#10645 )

2024-11-25 18:32:09 -08:00

llava_next_video.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

llava_next.py

[Model] Add Support for Multimodal Granite Models (#10291 )

2024-11-21 10:46:20 +00:00

llava_onevision.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

llava.py

[Model] Add Support for Multimodal Granite Models (#10291 )

2024-11-21 10:46:20 +00:00

mamba_cache.py

[Kernel][Model] Improve continuous batching for Jamba and Mamba (#9189 )

2024-10-16 12:12:43 -04:00

mamba.py

[Bugfix] Fix Mamba model initialization and MLP Speculator weights loading (#10456 )

2024-11-20 05:04:05 +00:00

medusa.py

[model] Reduce medusa weight (#10454 )

2024-11-20 06:05:55 +00:00

minicpm3.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

minicpm.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

minicpmv.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

mixtral_quant.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

mixtral.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

mllama.py

[Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593 )

2024-11-23 18:12:20 +00:00

mlp_speculator.py

[Bugfix] Fix Mamba model initialization and MLP Speculator weights loading (#10456 )

2024-11-20 05:04:05 +00:00

module_mapping.py

[Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199 )

2024-09-29 06:59:45 +00:00

molmo.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

mpt.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

nemotron.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

nvlm_d.py

[Bugfix] Fix _init_vision_model in NVLM_D model (#9611 )

2024-10-23 14:09:04 +00:00

olmo2.py

[Model] Add OLMo November 2024 model (#10503 )

2024-11-25 17:26:40 -05:00

olmo.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

olmoe.py

[model][utils] add extract_layer_index utility function (#10599 )

2024-11-23 22:22:54 -08:00

opt.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

orion.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

paligemma.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

persimmon.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

phi3_small.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

phi3.py

[Bugfix]Fix Phi-3 BNB online quantization (#10417 )

2024-11-19 03:21:42 +00:00

phi3v.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

phi.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

phimoe.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

pixtral.py

[Model] Add Support for Multimodal Granite Models (#10291 )

2024-11-21 10:46:20 +00:00

qwen2_audio.py

[Bugfix] Allow token ID-only inputs in Qwen2-Audio (#10536 )

2024-11-21 18:09:43 +00:00

qwen2_cls.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

qwen2_moe.py

[model][utils] add extract_layer_index utility function (#10599 )

2024-11-23 22:22:54 -08:00

qwen2_rm.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

qwen2_vl.py

[torch.compile] limit inductor threads and lazy import quant (#10482 )

2024-11-20 18:36:33 -08:00

qwen2.py

[Model] Enable optional prefix when loading embedding models (#10639 )

2024-11-25 18:14:33 +00:00

qwen.py

support bitsandbytes quantization with qwen model (#10549 )

2024-11-22 16:16:14 -08:00

registry.py

[Model] Add OLMo November 2024 model (#10503 )

2024-11-25 17:26:40 -05:00

roberta.py

[Model] Enable optional prefix when loading embedding models (#10639 )

2024-11-25 18:14:33 +00:00

siglip.py

[Model] Add Support for Multimodal Granite Models (#10291 )

2024-11-21 10:46:20 +00:00

solar.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

stablelm.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

starcoder2.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00

ultravox.py

[Misc] Add uninitialized params tracking for AutoWeightsLoader (#10327 )

2024-11-18 09:07:46 +08:00

utils.py

[model][utils] add extract_layer_index utility function (#10599 )

2024-11-23 22:22:54 -08:00

xverse.py

[torch.compile] support all attention backends (#10558 )

2024-11-22 14:04:42 -08:00