Woosuk Kwon 84e4e37d14 [Minor] Fix type annotations (#1238)

2023-10-02 15:28:31 -07:00

..

layers

[Minor] Fix type annotations (#1238)

2023-10-02 15:28:31 -07:00

models

support sharding llama2-70b on more than 8 GPUs (#1209)

2023-10-02 15:26:33 -07:00

parallel_utils

[FIX] Don't initialize parameter by default (#1067)

2023-09-17 17:15:38 -07:00

quantization_utils

Add minimum capability requirement for AWQ (#1064)

2023-09-18 12:02:01 -07:00

__init__.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

input_metadata.py

[Mistral] Mistral-7B-v0.1 support (#1196)

2023-09-28 10:41:03 -07:00

model_loader.py

[Mistral] Mistral-7B-v0.1 support (#1196)

2023-09-28 10:41:03 -07:00

utils.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

weight_utils.py

Implement AWQ quantization support for LLaMA (#1032)

2023-09-16 00:03:37 -07:00