ljss 5687d584fe [BugFix] Set engine_use_ray=True when TP>1 (#1531)

2023-11-01 02:14:18 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Support SqueezeLLM (#1326)

2023-10-21 23:14:59 -07:00

async_llm_engine.py

[BugFix] Set engine_use_ray=True when TP>1 (#1531)

2023-11-01 02:14:18 -07:00

llm_engine.py

Add support for spaces_between_special_tokens

2023-10-30 16:52:56 -07:00

ray_utils.py

fix typo (#1184)

2023-09-27 16:22:45 -07:00