Cyrus Leung aa39a8e175 [Doc] Create a new "Usage" section (#10827) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-12-05 11:19:35 +08:00

..

__init__.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

interfaces.py

[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038)

2024-10-06 12:48:11 -07:00

multi_step.py

[Doc] Create a new "Usage" section (#10827)

2024-12-05 11:19:35 +08:00

single_step.py

[core] simplify seq group code (#9569)

2024-10-24 00:16:44 -07:00

stop_checker.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

util.py

[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)

2024-10-16 22:55:59 +00:00