Antoni Baum 005ba458b5 Set torch default dtype in a context manager (#971) ...

Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>

2023-09-07 15:39:37 +09:00

..

core

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

engine

Use queue for finished requests (#957)

2023-09-05 19:27:23 -07:00

entrypoints

Initialize AsyncLLMEngine bg loop correctly (#943)

2023-09-04 17:41:22 -07:00

model_executor

Set torch default dtype in a context manager (#971)

2023-09-07 15:39:37 +09:00

transformers_utils

Only emit warning about internal tokenizer if it isn't being used (#939)

2023-09-05 00:50:55 +09:00

worker

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

__init__.py

Bump up the version to v0.1.4 (#846)

2023-08-25 12:28:00 +09:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

fix: incorrect bigcode attention heads num (#676)

2023-08-04 10:35:22 -07:00

logger.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

outputs.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sampling_params.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sequence.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

utils.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00