Cade Daniel e95cd87959 [Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

..

output_processor

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Core] Refactor model loading code (#4097)

2024-04-16 11:34:39 -07:00

async_llm_engine.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

llm_engine.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

metrics.py

[Bugfix] fix_log_time_in_metrics (#4050)

2024-04-13 07:52:36 -07:00

ray_utils.py

[mypy] Add mypy type annotation part 1 (#4006)

2024-04-12 14:35:50 -07:00