Woosuk Kwon fd5dcc5c81 Optimize GeGLU layer in Gemma (#2975)

2024-02-21 20:17:52 -08:00

..

__init__.py

Migrate MistralForCausalLM to LlamaForCausalLM (#2868)

2024-02-21 18:25:05 -08:00

baichuan.py

Revert "Refactor llama family models (#2637)" (#2851)

2024-02-13 09:24:59 -08:00

bloom.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

chatglm.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

decilm.py

chore(vllm): codespell for spell checking (#2820)

2024-02-21 18:56:01 -08:00

deepseek.py

Add fused top-K softmax kernel for MoE (#2769)

2024-02-05 17:38:02 -08:00

falcon.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

gemma.py

Optimize GeGLU layer in Gemma (#2975)

2024-02-21 20:17:52 -08:00

gpt2.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

gpt_bigcode.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

gpt_j.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

gpt_neox.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

internlm2.py

Revert "Refactor llama family models (#2637)" (#2851)

2024-02-13 09:24:59 -08:00

llama.py

Migrate MistralForCausalLM to LlamaForCausalLM (#2868)

2024-02-21 18:25:05 -08:00

mixtral_quant.py

Add quantized mixtral support (#2673)

2024-01-30 16:34:10 -08:00

mixtral.py

Align LoRA code between Mistral and Mixtral (fixes #2875) (#2880)

2024-02-15 01:00:43 +01:00

mpt.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

olmo.py

Support OLMo models. (#2832)

2024-02-18 21:05:15 -08:00

opt.py

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

phi.py

Address Phi modeling update 2 (#2428)

2024-01-12 12:16:49 -08:00

qwen2.py

fix names and license for Qwen2 (#2589)

2024-01-24 22:37:51 -08:00

qwen.py

Revert "Refactor llama family models (#2637)" (#2851)

2024-02-13 09:24:59 -08:00

stablelm.py

Revert "Refactor llama family models (#2637)" (#2851)

2024-02-13 09:24:59 -08:00