Antoni Baum 9841d48a10 Use TGI-like incremental detokenization (#984)

2023-09-13 13:38:01 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Make max_model_len configurable (#972)

2023-09-12 16:29:19 -07:00

async_llm_engine.py

add option to shorten prompt print in log (#991)

2023-09-12 15:10:14 -07:00

llm_engine.py

Use TGI-like incremental detokenization (#984)

2023-09-13 13:38:01 -07:00

ray_utils.py

fix "tansformers_module" ModuleNotFoundError when load model with trust_remote_code=True (#871)

2023-09-08 17:21:30 -07:00