SangBin ChoandRobert Shaw e7c46b9527 [Scheduler] Warning upon preemption and Swapping (#4647) ...

Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

2024-05-13 23:50:44 +09:00

..

output_processor

[Speculative decoding] Support target-model logprobs (#4378)

2024-05-03 15:52:01 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

async_llm_engine.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llm_engine.py

[Scheduler] Warning upon preemption and Swapping (#4647)

2024-05-13 23:50:44 +09:00

metrics.py

[Scheduler] Warning upon preemption and Swapping (#4647)

2024-05-13 23:50:44 +09:00