Antoni BaumandZhuohan Li 080438477f Start background task in AsyncLLMEngine.generate (#988) ...

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2023-09-08 00:03:39 -07:00

..

core

Make AsyncLLMEngine more robust & fix batched abort (#969)

2023-09-07 13:43:45 -07:00

engine

Start background task in AsyncLLMEngine.generate (#988)

2023-09-08 00:03:39 -07:00

entrypoints

Start background task in AsyncLLMEngine.generate (#988)

2023-09-08 00:03:39 -07:00

model_executor

faster startup of vLLM (#982)

2023-09-08 14:48:54 +09:00

transformers_utils

Only emit warning about internal tokenizer if it isn't being used (#939)

2023-09-05 00:50:55 +09:00

worker

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

__init__.py

Bump up the version to v0.1.5 (#944)

2023-09-07 16:15:31 -07:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

Enable safetensors loading for all models (#974)

2023-09-07 15:49:52 -07:00

logger.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

outputs.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sampling_params.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sequence.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

utils.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00