Cade Daniel 62b8aebc6f [Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

..

output_processor

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

async_llm_engine.py

[Frontend] Enable support for CPU backend in AsyncLLMEngine. (#3993)

2024-04-22 09:19:51 +00:00

llm_engine.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

metrics.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

ray_utils.py

[Core] RayWorkerVllm --> WorkerWrapper to reduce duplication (#4024)

2024-04-17 08:34:33 +00:00