Michael Goin b4fe16c75b Add vllm bench [latency, throughput] CLI commands (#16508) ...

Signed-off-by: mgoin <mgoin64@gmail.com>

2025-04-14 23:10:35 -07:00

..

benchmark

Add vllm bench [latency, throughput] CLI commands (#16508)

2025-04-14 23:10:35 -07:00

__init__.py

[Frontend] Move CLI code into vllm.cmd package (#12971)

2025-02-12 23:12:21 -08:00

main.py

[Bugfix] set VLLM_WORKER_MULTIPROC_METHOD=spawn for vllm.entrypoionts.openai.api_server (#15700)

2025-03-28 21:12:26 -07:00

openai.py

[Misc] add description attribute in CLI (#15921)

2025-04-07 22:30:35 +00:00

serve.py

[Misc] add description attribute in CLI (#15921)

2025-04-07 22:30:35 +00:00

types.py

[Frontend] Move CLI code into vllm.cmd package (#12971)

2025-02-12 23:12:21 -08:00