youkaichao 8fe8386591 [Kernel] change benchmark script so that result can be directly used; tune moe kernel in A100/H100 with tp=2,4,8 (#3389)

2024-03-14 08:11:48 +00:00

..

attention

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

fused_moe

[Kernel] change benchmark script so that result can be directly used; tune moe kernel in A100/H100 with tp=2,4,8 (#3389)

2024-03-14 08:11:48 +00:00

quantization

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Add kernel for GeGLU with approximate GELU (#3337)

2024-03-12 22:06:17 -07:00

layernorm.py

Revert "Refactor llama family models (#2637)" (#2851)

2024-02-13 09:24:59 -08:00

linear.py

[Minor] Fix bias in if to remove ambiguity (#3259)

2024-03-13 09:16:55 -07:00

rejection_sampler.py

[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103)

2024-03-08 23:32:46 -08:00

rotary_embedding.py

Fix lint (#3388)

2024-03-13 13:56:49 -07:00

sampler.py

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

vocab_parallel_embedding.py

Remove hardcoded device="cuda" to support more devices (#2503)

2024-02-01 15:46:39 -08:00