vLLM/vllm/model_executor/models at f954d0715c8b68e780aac4a4f3ffd1ab56bebfcd - vLLM

__init__.py

[Model] Initial support for BLIP-2 (#5920 )

2024-07-27 11:53:07 +00:00

arctic.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

baichuan.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

blip2.py

[Model] Initial support for BLIP-2 (#5920 )

2024-07-27 11:53:07 +00:00

blip.py

[Model] Initial support for BLIP-2 (#5920 )

2024-07-27 11:53:07 +00:00

bloom.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

chameleon.py

[Bugfix] Fix token padding for chameleon (#6724 )

2024-07-24 01:05:09 -07:00

chatglm.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

clip.py

[VLM] Minor space optimization for ClipVisionModel (#6436 )

2024-07-15 17:29:51 +08:00

commandr.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

dbrx.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018 )

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Model] Pipeline Parallel Support for DeepSeek v2 (#6519 )

2024-07-23 12:22:09 -07:00

deepseek.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

falcon.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

fuyu.py

[Model] Initialize Fuyu-8B support (#3924 )

2024-07-14 05:27:14 +00:00

gemma2.py

[Kernel][Model] logits_soft_cap for Gemma2 with flashinfer (#6051 )

2024-07-04 16:35:51 -07:00

gemma.py

[Bugfix] Fix dtype mismatch in PaliGemma (#6367 )

2024-07-12 08:22:18 -07:00

gpt2.py

[ Misc ] non-uniform quantization via compressed-tensors for Llama (#6515 )

2024-07-18 22:39:18 -04:00

gpt_bigcode.py

[Bugfix] GPTBigCodeForCausalLM: Remove lm_head from supported_lora_modules. (#6326 )

2024-07-11 07:05:59 -07:00

gpt_j.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

gpt_neox.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

interfaces.py

[BugFix][Model] Jamba - Handle aborted requests, Add tests and fix cleanup bug (#6425 )

2024-07-16 01:32:55 +00:00

internlm2.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

jais.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

jamba.py

[Bugfix][Model] Jamba assertions and no chunked prefill by default for Jamba (#6784 )

2024-07-26 20:45:31 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

llama.py

[Model] Adding support for MiniCPM-V (#4087 )

2024-07-24 20:59:30 -07:00

llava_next.py

[Bugfix] Fix vocab_size field access in llava_next.py (#6624 )

2024-07-22 05:02:51 +00:00

llava.py

[Bugfix] Fix vocab_size field access in llava_next.py (#6624 )

2024-07-22 05:02:51 +00:00

medusa.py

[Speculative Decoding] Medusa Implementation with Top-1 proposer (#4978 )

2024-07-09 18:34:02 -07:00

minicpm.py

[Model] Adding support for MiniCPM-V (#4087 )

2024-07-24 20:59:30 -07:00

minicpmv.py

[Model] Adding support for MiniCPM-V (#4087 )

2024-07-24 20:59:30 -07:00

mixtral_quant.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

mixtral.py

[ Misc ] non-uniform quantization via compressed-tensors for Llama (#6515 )

2024-07-18 22:39:18 -04:00

mlp_speculator.py

[Bugfix] MLPSpeculator: Use ParallelLMHead in tie_weights=False case. (#6303 )

2024-07-10 09:04:07 -04:00

mpt.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

nemotron.py

[Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611 )

2024-07-26 14:33:42 -04:00

olmo.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

opt.py

[Model] Initial support for BLIP-2 (#5920 )

2024-07-27 11:53:07 +00:00

orion.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

paligemma.py

[Bugfix] Fix dtype mismatch in PaliGemma (#6367 )

2024-07-12 08:22:18 -07:00

persimmon.py

[Model] Initialize Fuyu-8B support (#3924 )

2024-07-14 05:27:14 +00:00

phi3_small.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

phi3v.py

[Model] Refactor and decouple phi3v image embedding (#6621 )

2024-07-21 16:07:58 -07:00

phi.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

qwen2_moe.py

[ Misc ] Apply MoE Refactor to Deepseekv2 To Support Fp8 (#6417 )

2024-07-13 20:03:58 -07:00

qwen2.py

[Kernel][Attention] Separate Attention.kv_scale into k_scale and v_scale (#6081 )

2024-07-16 15:31:32 -07:00

qwen.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

stablelm.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

starcoder2.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00

utils.py

[ Misc ] non-uniform quantization via compressed-tensors for Llama (#6515 )

2024-07-18 22:39:18 -04:00

xverse.py

[CORE] Quantized lm-head Framework (#4442 )

2024-07-02 22:25:17 +00:00