Cyrus Leung 2c0d933594 [Bugfix] Fix LLaVA-NeXT (#5380)

2024-06-10 15:38:47 +00:00

..

__init__.py

[Model] Initial support for LLaVA-NeXT (#4199)

2024-06-10 12:47:15 +00:00

arctic.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

baichuan.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

bloom.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

chatglm.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

commandr.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

dbrx.py

fix DbrxFusedNormAttention missing cache_config (#5340)

2024-06-07 14:10:21 -07:00

decilm.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

deepseek.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

falcon.py

[Model] Add support for falcon-11B (#5069)

2024-05-27 16:41:43 -07:00

gemma.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

gpt2.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

gpt_bigcode.py

[Model] LoRA gptbigcode implementation (#3949)

2024-05-22 13:58:59 -07:00

gpt_j.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

gpt_neox.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

internlm2.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

jais.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[Feature][Kernel] Support bitsandbytes quantization and QLoRA (#4776)

2024-06-01 14:51:10 -06:00

llava_next.py

[Bugfix] Fix LLaVA-NeXT (#5380)

2024-06-10 15:38:47 +00:00

llava.py

[Model] Initial support for LLaVA-NeXT (#4199)

2024-06-10 12:47:15 +00:00

minicpm.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

mixtral_quant.py

[Bugfix / Core] Prefix Caching Guards (merged with main) (#4846)

2024-05-27 15:18:17 -07:00

mixtral.py

[Misc][Breaking] Change FP8 checkpoint format from act_scale -> input_scale (#5353)

2024-06-08 13:54:05 -04:00

mpt.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

olmo.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

opt.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

orion.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

phi3_small.py

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)

2024-05-24 22:00:52 -07:00

phi.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

qwen2_moe.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

qwen2.py

[Bugfix / Core] Prefix Caching Guards (merged with main) (#4846)

2024-05-27 15:18:17 -07:00

qwen.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

stablelm.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

starcoder2.py

[Bugfix / Core] Prefix Caching Guards (merged with main) (#4846)

2024-05-27 15:18:17 -07:00

vlm_base.py

[Bugfix][Model] Add base class for vision-language models (#4809)

2024-05-19 00:13:33 -07:00

xverse.py

[Bugfix / Core] Prefix Caching Guards (merged with main) (#4846)

2024-05-27 15:18:17 -07:00