5 people 6ace6fba2c [V1] AsyncLLM Implementation (#9826) ...

Signed-off-by: Nick Hill <nickhill@us.ibm.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2024-11-11 23:05:38 +00:00

..

__init__.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

interfaces.py

[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038)

2024-10-06 12:48:11 -07:00

multi_step.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

single_step.py

[core] simplify seq group code (#9569)

2024-10-24 00:16:44 -07:00

stop_checker.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

util.py

[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)

2024-10-16 22:55:59 +00:00