Thomas ParnellandJan van Lunteren cf2f084d56 Dynamic scheduler delay to improve ITL performance (#3279) ...

Co-authored-by: Jan van Lunteren <jvl@zurich.ibm.com>

2024-03-22 12:28:14 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Dynamic scheduler delay to improve ITL performance (#3279)

2024-03-22 12:28:14 -07:00

async_llm_engine.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

llm_engine.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

metrics.py

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

ray_utils.py

[Core] print error before deadlock (#3459)

2024-03-19 04:06:23 +00:00