Zhuohan LiandAntoni Baum 947b794146 [Sampler] Vectorized sampling (simplified) (#1048) ...

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

2023-09-22 17:48:04 -07:00

..

layers

[Sampler] Vectorized sampling (simplified) (#1048)

2023-09-22 17:48:04 -07:00

models

rope_theta and max_position_embeddings from config (#1096)

2023-09-20 13:35:11 -07:00

parallel_utils

[FIX] Don't initialize parameter by default (#1067)

2023-09-17 17:15:38 -07:00

quantization_utils

Add minimum capability requirement for AWQ (#1064)

2023-09-18 12:02:01 -07:00

__init__.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

input_metadata.py

Add support for BLOOM (#331)

2023-07-03 13:12:35 -07:00

model_loader.py

Add minimum capability requirement for AWQ (#1064)

2023-09-18 12:02:01 -07:00

utils.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

weight_utils.py

Implement AWQ quantization support for LLaMA (#1032)

2023-09-16 00:03:37 -07:00