Cody YuandCade Daniel f942efb5a3 [Dynamic Spec Decoding] Auto-disable by the running queue size (#4592) ...

Co-authored-by: Cade Daniel <edacih@gmail.com>

2024-05-08 21:44:00 +00:00

..

output_processor

[Speculative decoding] Support target-model logprobs (#4378)

2024-05-03 15:52:01 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Dynamic Spec Decoding] Auto-disable by the running queue size (#4592)

2024-05-08 21:44:00 +00:00

async_llm_engine.py

[Bugfix] Fix asyncio.Task not being subscriptable (#4623)

2024-05-06 09:31:05 -07:00

llm_engine.py

[Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (#3937)

2024-05-04 15:39:34 -07:00

metrics.py

[Bugfix] Fix 307 Redirect for /metrics (#4523)

2024-05-01 09:14:13 -07:00