3 people 1f24755bf8 Support SqueezeLLM (#1326) ...

Co-authored-by: squeeze-ai-lab <squeezeailab.bair@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2023-10-21 23:14:59 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Support SqueezeLLM (#1326)

2023-10-21 23:14:59 -07:00

async_llm_engine.py

Use monotonic time where appropriate (#1249)

2023-10-02 19:22:05 -07:00

llm_engine.py

Implement prompt logprobs & Batched topk for computing logprobs (#1328)

2023-10-16 10:56:50 -07:00

ray_utils.py

fix typo (#1184)

2023-09-27 16:22:45 -07:00