Harry MellorandHarry Mellor 682789d402 Fix missing docs and out of sync EngineArgs (#4219) ...

Co-authored-by: Harry Mellor <hmellor@oxts.com>

2024-04-19 20:51:33 -07:00

..

output_processor

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Fix missing docs and out of sync EngineArgs (#4219)

2024-04-19 20:51:33 -07:00

async_llm_engine.py

[Bugfix][Core] Restore logging of stats in the async engine (#4150)

2024-04-19 08:08:26 -07:00

llm_engine.py

Support eos_token_id from generation_config.json (#4182)

2024-04-19 04:13:36 +00:00

metrics.py

[Bugfix] fix_log_time_in_metrics (#4050)

2024-04-13 07:52:36 -07:00

ray_utils.py

[Core] RayWorkerVllm --> WorkerWrapper to reduce duplication (#4024)

2024-04-17 08:34:33 +00:00