Zhuohan LiandYunmo Chen 9d9072a069 Implement prompt logprobs & Batched topk for computing logprobs (#1328) ...

Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>

2023-10-16 10:56:50 -07:00

..

quantized_linear

TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)

2023-10-02 15:36:09 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Implement approximate GELU kernels (#828)

2023-08-23 07:43:21 +09:00

attention.py

Implement prompt logprobs & Batched topk for computing logprobs (#1328)

2023-10-16 10:56:50 -07:00

layernorm.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

rotary_embedding.py

Support Longchat and RoPE scaling (#555)

2023-09-27 03:36:02 -07:00

sampler.py

Implement prompt logprobs & Batched topk for computing logprobs (#1328)

2023-10-16 10:56:50 -07:00