vLLM/vllm/model_executor/models at 4e2d95e372ad5fbef7b27c66d527c37477c0c8bb - vLLM

__init__.py

[Model] Molmo vLLM Integration (#9016 )

2024-10-14 07:56:24 -07:00

arctic.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

baichuan.py

[torch.compile] Adding torch compile annotations to some models (#9614 )

2024-10-23 10:07:48 -07:00

bart.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631 )

2024-09-17 07:35:01 -07:00

bert.py

Support BERTModel (first encoder-only embedding model) (#9056 )

2024-10-17 23:21:01 +00:00

blip2.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

blip.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

bloom.py

[torch.compile] Adding torch compile annotations to some models (#9614 )

2024-10-23 10:07:48 -07:00

chameleon.py

[Core] Rename input data types (#8688 )

2024-10-16 10:49:37 +00:00

chatglm.py

[Bugfix] Fix PP for ChatGLM and Molmo (#9422 )

2024-10-24 06:12:05 +00:00

clip.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

commandr.py

[torch.compile] Adding torch compile annotations to some models (#9614 )

2024-10-23 10:07:48 -07:00

dbrx.py

[Model] Remap FP8 kv_scale in CommandR and DBRX (#9174 )

2024-10-09 06:43:06 +00:00

decilm.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

deepseek_v2.py

[Misc] Standardize RoPE handling for Qwen2-VL (#9250 )

2024-10-16 13:56:17 +08:00

deepseek.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

eagle.py

[Bugfix] Eagle: change config name for fc bias (#9580 )

2024-10-22 16:14:22 +00:00

exaone.py

[Hardware][ROCM] using current_platform.is_rocm (#9642 )

2024-10-28 04:07:00 +00:00

falcon.py

support bitsandbytes quantization with more models (#9148 )

2024-10-08 19:52:19 -06:00

florence2.py

[Model] Initialize Florence-2 language backbone support (#9555 )

2024-10-23 10:42:47 +00:00

fuyu.py

[Core] Rename input data types (#8688 )

2024-10-16 10:49:37 +00:00

gemma2.py

[torch.compile] auto infer dynamic_arg_dims from type annotation (#9589 )

2024-10-22 13:43:37 -07:00

gemma.py

[torch.compile] Adding torch compile annotations to some models (#9614 )

2024-10-23 10:07:48 -07:00

glm4_vision_encoder.py

[Model] Add GLM-4v support and meet vllm==0.6.2 (#9242 )

2024-10-11 17:36:13 +00:00

gpt2.py

[torch.compile] Adding torch compile annotations to some models (#9614 )

2024-10-23 10:07:48 -07:00

gpt_bigcode.py

[torch.compile] expanding support and fix allgather compilation (#9637 )

2024-10-24 01:32:15 -07:00

gpt_j.py

[torch.compile] expanding support and fix allgather compilation (#9637 )

2024-10-24 01:32:15 -07:00

gpt_neox.py

[torch.compile] expanding support and fix allgather compilation (#9637 )

2024-10-24 01:32:15 -07:00

granite.py

[Hardware][ROCM] using current_platform.is_rocm (#9642 )

2024-10-28 04:07:00 +00:00

granitemoe.py

[Model] add a lora module for granite 3.0 MoE models (#9673 )

2024-10-24 22:00:17 -07:00

idefics2_vision_model.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

interfaces_base.py

[Model] Explicit interface for vLLM models and support OOT embedding models (#9108 )

2024-10-07 06:10:35 +00:00

interfaces.py

[Model] Support Mamba (#6484 )

2024-10-11 15:40:06 +00:00

intern_vit.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

internlm2_ve.py

[Model][VLM] Initialize support for Mono-InternVL model (#9528 )

2024-10-22 16:01:46 +00:00

internlm2.py

[torch.compile] expanding support and fix allgather compilation (#9637 )

2024-10-24 01:32:15 -07:00

internvl.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

jais.py

[torch.compile] Adding torch compile annotations to some models (#9639 )

2024-10-24 00:54:57 -07:00

jamba.py

[Kernel][Model] Improve continuous batching for Jamba and Mamba (#9189 )

2024-10-16 12:12:43 -04:00

llama.py

[Hardware][ROCM] using current_platform.is_rocm (#9642 )

2024-10-28 04:07:00 +00:00

llava_next_video.py

[Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653 )

2024-10-24 07:52:07 -07:00

llava_next.py

[Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650 )

2024-10-24 10:42:24 -07:00

llava_onevision.py

[Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653 )

2024-10-24 07:52:07 -07:00

llava.py

[Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653 )

2024-10-24 07:52:07 -07:00

mamba_cache.py

[Kernel][Model] Improve continuous batching for Jamba and Mamba (#9189 )

2024-10-16 12:12:43 -04:00

mamba.py

[Model] FalconMamba Support (#9325 )

2024-10-21 12:50:16 -04:00

medusa.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

minicpm3.py

[Bugfix]Fix MiniCPM's LoRA bug (#9286 )

2024-10-12 09:36:47 -07:00

minicpm.py

[torch.compile] Adding torch compile annotations to some models (#9639 )

2024-10-24 00:54:57 -07:00

minicpmv.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

mixtral_quant.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

mixtral.py

[Model] add a bunch of supported lora modules for mixtral (#9008 )

2024-10-04 16:24:40 +00:00

mllama.py

[Bugfix] Use "vision_model" prefix for MllamaVisionModel (#9628 )

2024-10-24 10:07:44 +08:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

module_mapping.py

[Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199 )

2024-09-29 06:59:45 +00:00

molmo.py

[Bugfix] Fix PP for ChatGLM and Molmo (#9422 )

2024-10-24 06:12:05 +00:00

mpt.py

[torch.compile] Adding torch compile annotations to some models (#9639 )

2024-10-24 00:54:57 -07:00

nemotron.py

[torch.compile] Adding torch compile annotations to some models (#9639 )

2024-10-24 00:54:57 -07:00

nvlm_d.py

[Bugfix] Fix _init_vision_model in NVLM_D model (#9611 )

2024-10-23 14:09:04 +00:00

olmo.py

[torch.compile] Adding torch compile annotations to some models (#9639 )

2024-10-24 00:54:57 -07:00

olmoe.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

opt.py

[torch.compile] Adding torch compile annotations to some models (#9641 )

2024-10-24 09:31:42 -07:00

orion.py

[torch.compile] Adding torch compile annotations to some models (#9641 )

2024-10-24 09:31:42 -07:00

paligemma.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

persimmon.py

[torch.compile] Adding torch compile annotations to some models (#9641 )

2024-10-24 09:31:42 -07:00

phi3_small.py

[Misc] Standardize RoPE handling for Qwen2-VL (#9250 )

2024-10-16 13:56:17 +08:00

phi3.py

[Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571 )

2024-09-20 08:54:02 +08:00

phi3v.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

phi.py

[Bugfix]: phi.py get rope_theta from config file (#9503 )

2024-10-22 02:53:36 +00:00

phimoe.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

pixtral.py

[Bugfix] Remove xformers requirement for Pixtral (#9597 )

2024-10-24 15:38:05 -07:00

qwen2_audio.py

[Model] Add Qwen2-Audio model support (#9248 )

2024-10-23 17:54:22 +00:00

qwen2_cls.py

[Model] Add classification Task with Qwen2ForSequenceClassification (#9704 )

2024-10-26 17:53:35 +00:00

qwen2_moe.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

qwen2_rm.py

[Bugfix] Fix PP for ChatGLM and Molmo (#9422 )

2024-10-24 06:12:05 +00:00

qwen2_vl.py

[Bugfix] Fix PP for ChatGLM and Molmo (#9422 )

2024-10-24 06:12:05 +00:00

qwen2.py

support TP in qwen2 bnb (#9574 )

2024-10-22 07:13:23 +00:00

qwen.py

[Core] Rename input data types (#8688 )

2024-10-16 10:49:37 +00:00

registry.py

[Hardware][ROCM] using current_platform.is_rocm (#9642 )

2024-10-28 04:07:00 +00:00

siglip.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

solar.py

[Hardware][ROCM] using current_platform.is_rocm (#9642 )

2024-10-28 04:07:00 +00:00

stablelm.py

[Models] Add remaining model PP support (#7168 )

2024-10-04 10:56:58 +08:00

starcoder2.py

[torch.compile] Adding torch compile annotations to some models (#9641 )

2024-10-24 09:31:42 -07:00

ultravox.py

[Model] Add Qwen2-Audio model support (#9248 )

2024-10-23 17:54:22 +00:00

utils.py

[Bugfix] Fix PP for ChatGLM and Molmo (#9422 )

2024-10-24 06:12:05 +00:00

xverse.py

[torch.compile] Adding torch compile annotations to some models (#9641 )

2024-10-24 09:31:42 -07:00