Philipp MoritzandRoger Wang 17c3103c56 Make it easy to profile workers with nsight (#3162) ...

Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

2024-03-03 16:19:13 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Make it easy to profile workers with nsight (#3162)

2024-03-03 16:19:13 -08:00

async_llm_engine.py

Add Automatic Prefix Caching (#2762)

2024-03-02 00:50:01 -08:00

llm_engine.py

Make it easy to profile workers with nsight (#3162)

2024-03-03 16:19:13 -08:00

metrics.py

allow user chose log level by --log-level instead of fixed 'info'. (#3109)

2024-03-01 23:28:41 +00:00

ray_utils.py

[Ray] Integration compiled DAG off by default (#2471)

2024-02-08 09:57:25 -08:00