Robert IrvineandRobert Irvine 4b5bcf8906 faster startup of vLLM (#982) ...

* update

---------

Co-authored-by: Robert Irvine <robert@seamlessml.com>

2023-09-08 14:48:54 +09:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Implement approximate GELU kernels (#828)

2023-08-23 07:43:21 +09:00

attention.py

faster startup of vLLM (#982)

2023-09-08 14:48:54 +09:00

layernorm.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

sampler.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00