5 people 5b59532760 [Model][VLM] Add LLaVA-Onevision model support (#8486) ...

Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-09-22 10:51:44 -07:00

..

__init__.py

[Model][VLM] Add LLaVA-Onevision model support (#8486)

2024-09-22 10:51:44 -07:00

arctic.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

baichuan.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

bart.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631)

2024-09-17 07:35:01 -07:00

blip2.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

blip.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

bloom.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

chameleon.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

chatglm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

clip.py

[Model][VLM] Add LLaVA-Onevision model support (#8486)

2024-09-22 10:51:44 -07:00

commandr.py

[Bugfix] Correct adapter usage for cohere and jamba (#8292)

2024-09-09 11:20:46 -07:00

dbrx.py

[dbrx] refactor dbrx experts to extend FusedMoe class (#8518)

2024-09-21 15:09:39 -06:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018)

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

deepseek.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

eagle.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

exaone.py

[Bugfix] Fix import error in Exaone model (#8034)

2024-08-30 08:03:28 -07:00

falcon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

fuyu.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

gemma2.py

[Gemma2] add bitsandbytes support for Gemma2 (#8338)

2024-09-11 21:53:12 -07:00

gemma.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_bigcode.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_j.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_neox.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

granite.py

[Bugfix] Fix TP > 1 for new granite (#8544)

2024-09-17 23:17:08 +00:00

idefics2_vision_model.py

[Model]Refactor MiniCPMV (#7020)

2024-08-04 08:12:41 +00:00

interfaces.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

intern_vit.py

[Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061)

2024-09-03 21:37:52 +08:00

internlm2.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860)

2024-09-05 11:33:37 +00:00

internvl.py

[Bugfix] Refactor composite weight loading logic (#8656)

2024-09-22 04:33:27 +00:00

jais.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

jamba.py

[Kernel][Misc] register ops to prevent graph breaks (#6917)

2024-09-11 12:52:19 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[Model] Allow loading from original Mistral format (#8168)

2024-09-06 17:02:05 -06:00

llava_next_video.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

llava_next.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

llava_onevision.py

[Model][VLM] Add LLaVA-Onevision model support (#8486)

2024-09-22 10:51:44 -07:00

llava.py

[Bugfix] Refactor composite weight loading logic (#8656)

2024-09-22 04:33:27 +00:00

medusa.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

minicpm3.py

[Model] support minicpm3 (#8297)

2024-09-14 14:50:26 +00:00

minicpm.py

[Model] support minicpm3 (#8297)

2024-09-14 14:50:26 +00:00

minicpmv.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

mixtral_quant.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mixtral.py

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mpt.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

na_vit.py

[Model]Refactor MiniCPMV (#7020)

2024-08-04 08:12:41 +00:00

nemotron.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

olmo.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

olmoe.py

[Model] Add OLMoE (#7922)

2024-09-20 09:31:41 -07:00

opt.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

orion.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

paligemma.py

[Bugfix] Refactor composite weight loading logic (#8656)

2024-09-22 04:33:27 +00:00

persimmon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phi3_small.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phi3.py

[Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571)

2024-09-20 08:54:02 +08:00

phi3v.py

[Model] Multi-input support for LLaVA (#8238)

2024-09-07 02:57:24 +00:00

phi.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phimoe.py

[Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571)

2024-09-20 08:54:02 +08:00

pixtral.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687)

2024-09-20 23:28:56 -07:00

qwen2_moe.py

[Misc] Skip loading extra bias for Qwen2-MOE GPTQ models (#8329)

2024-09-10 20:59:19 -04:00

qwen2_vl.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687)

2024-09-20 23:28:56 -07:00

qwen2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

qwen.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687)

2024-09-20 23:28:56 -07:00

siglip.py

[Model][VLM] Add LLaVA-Onevision model support (#8486)

2024-09-22 10:51:44 -07:00

solar.py

[Model] Support Solar Model (#8386)

2024-09-18 11:04:00 -06:00

stablelm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

starcoder2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

ultravox.py

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407)

2024-09-22 12:24:21 +00:00

utils.py

[Bugfix] Refactor composite weight loading logic (#8656)

2024-09-22 04:33:27 +00:00

xverse.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00