Nick Hill eb6d3c264d [Core] Eliminate parallel worker per-step task scheduling overhead (#4894)

2024-05-23 06:17:27 +09:00

..

output_processor

[Lora] Support long context lora (#4787)

2024-05-18 16:05:23 +09:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

2024-05-22 13:28:20 -07:00

async_llm_engine.py

[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)

2024-05-23 06:17:27 +09:00

llm_engine.py

[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)

2024-05-23 06:17:27 +09:00

metrics.py

[Scheduler] Warning upon preemption and Swapping (#4647)

2024-05-13 23:50:44 +09:00