3 people d6545ad22e add option to shorten prompt print in log (#991) ...

Signed-off-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2023-09-12 15:10:14 -07:00

..

core

Make AsyncLLMEngine more robust & fix batched abort (#969)

2023-09-07 13:43:45 -07:00

engine

add option to shorten prompt print in log (#991)

2023-09-12 15:10:14 -07:00

entrypoints

Start background task in AsyncLLMEngine.generate (#988)

2023-09-08 00:03:39 -07:00

model_executor

Use FP32 in RoPE initialization (#1004)

2023-09-11 00:26:35 -07:00

transformers_utils

Only emit warning about internal tokenizer if it isn't being used (#939)

2023-09-05 00:50:55 +09:00

worker

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

__init__.py

Bump up the version to v0.1.7 (#1013)

2023-09-11 00:54:30 -07:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

fix: CUDA error when inferencing with Falcon-40B base model (#992)

2023-09-10 01:39:02 -07:00

logger.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

outputs.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sampling_params.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sequence.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

utils.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00