3 people 151ef4efd2 [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) ...

Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2024-10-07 11:55:12 +00:00

..

__init__.py

[Model] Explicit interface for vLLM models and support OOT embedding models (#9108)

2024-10-07 06:10:35 +00:00

arctic.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

baichuan.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

bart.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631)

2024-09-17 07:35:01 -07:00

blip2.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

blip.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

bloom.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

chameleon.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

chatglm.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

clip.py

[Model][VLM] Add LLaVA-Onevision model support (#8486)

2024-09-22 10:51:44 -07:00

commandr.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

dbrx.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

decilm.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

deepseek_v2.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

deepseek.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

eagle.py

[Bugfix] load fc bias from config for eagle (#8790)

2024-09-24 23:16:30 -07:00

exaone.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

falcon.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

fuyu.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

gemma2_embedding.py

[Model] PP support for embedding models and update docs (#9090)

2024-10-06 16:35:27 +08:00

gemma2.py

[Model] PP support for embedding models and update docs (#9090)

2024-10-06 16:35:27 +08:00

gemma.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

gpt2.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

gpt_bigcode.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

gpt_j.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

gpt_neox.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

granite.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

granitemoe.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

idefics2_vision_model.py

[Model][LoRA]LoRA support added for MiniCPMV2.6 (#8943)

2024-09-30 04:31:55 +00:00

interfaces_base.py

[Model] Explicit interface for vLLM models and support OOT embedding models (#9108)

2024-10-07 06:10:35 +00:00

interfaces.py

[Model] Explicit interface for vLLM models and support OOT embedding models (#9108)

2024-10-07 06:10:35 +00:00

intern_vit.py

[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)

2024-10-07 11:55:12 +00:00

internlm2.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

internvl.py

[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)

2024-10-07 11:55:12 +00:00

jais.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

jamba.py

[Misc] Move registry to its own file (#9064)

2024-10-04 10:01:37 +00:00

llama_embedding.py

[Model] PP support for embedding models and update docs (#9090)

2024-10-06 16:35:27 +08:00

llama.py

[Core] Refactor GGUF parameters packing and forwarding (#8859)

2024-10-07 10:01:46 +00:00

llava_next_video.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

llava_next.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

llava_onevision.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

llava.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

medusa.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

minicpm3.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

minicpm.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

minicpmv.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

mixtral_quant.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

mixtral.py

[Model] add a bunch of supported lora modules for mixtral (#9008)

2024-10-04 16:24:40 +00:00

mllama.py

[Misc] Support quantization of MllamaForCausalLM (#8822)

2024-09-25 14:46:22 -07:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

module_mapping.py

[Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199)

2024-09-29 06:59:45 +00:00

mpt.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

nemotron.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

nvlm_d.py

[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)

2024-10-07 11:55:12 +00:00

olmo.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

olmoe.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

opt.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

orion.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

paligemma.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

persimmon.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

phi3_small.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

phi3.py

[Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571)

2024-09-20 08:54:02 +08:00

phi3v.py

[Bugfix] Fixes Phi3v & Ultravox Multimodal EmbeddingInputs (#8979)

2024-10-04 22:05:37 -07:00

phi.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

phimoe.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

pixtral.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

qwen2_moe.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

qwen2_rm.py

[Model] PP support for embedding models and update docs (#9090)

2024-10-06 16:35:27 +08:00

qwen2_vl.py

[Bugfix] Reshape the dimensions of the input image embeddings in Qwen2VL (#9071)

2024-10-04 14:34:58 +00:00

qwen2.py

[Model] PP support for embedding models and update docs (#9090)

2024-10-06 16:35:27 +08:00

qwen.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

registry.py

[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)

2024-10-07 11:55:12 +00:00

siglip.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

solar.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

stablelm.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

starcoder2.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00

ultravox.py

[Bugfix] Fixes Phi3v & Ultravox Multimodal EmbeddingInputs (#8979)

2024-10-04 22:05:37 -07:00

utils.py

[Model] PP support for embedding models and update docs (#9090)

2024-10-06 16:35:27 +08:00

xverse.py

[Models] Add remaining model PP support (#7168)

2024-10-04 10:56:58 +08:00