Roy 91a61da9b1 [Bugfix] fix load local safetensors model (#2512)

2024-01-19 16:26:16 -08:00

..

core

[BugFix] Fix abort_seq_group (#2463)

2024-01-18 15:10:42 -08:00

engine

[Experimental] Prefix Caching Support (#1669)

2024-01-17 16:32:10 -08:00

entrypoints

refactor complemention api for readability (#2499)

2024-01-18 16:45:14 -08:00

model_executor

[Bugfix] fix load local safetensors model (#2512)

2024-01-19 16:26:16 -08:00

transformers_utils

[Minor] Delete Llama tokenizer warnings (#2146)

2023-12-16 22:05:18 -08:00

worker

Simplify broadcast logic for control messages (#2501)

2024-01-19 11:23:30 -08:00

__init__.py

Bump up to v0.2.7 (#2337)

2024-01-03 17:35:56 -08:00

block.py

[Experimental] Prefix Caching Support (#1669)

2024-01-17 16:32:10 -08:00

config.py

Enable CUDA graph for GPTQ & SqueezeLLM (#2318)

2024-01-03 09:52:29 -08:00

logger.py

[Fix] Fix duplicated logging messages (#1524)

2023-10-31 09:04:47 -07:00

outputs.py

docs: add description (#1553)

2023-11-03 09:14:52 -07:00

prefix.py

fix: fix some args desc (#2487)

2024-01-18 09:41:44 -08:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509)

2023-10-30 14:50:47 -07:00

sampling_params.py

[Minor] Fix typo and remove unused code (#2305)

2024-01-02 19:23:15 -08:00

sequence.py

fix: fix some args desc (#2487)

2024-01-18 09:41:44 -08:00

utils.py

[Neuron] Add an option to build with neuron (#2065)

2024-01-18 10:58:50 -08:00