Varun Sundar RabindranathandVarun Sundar Rabindranath cb3b2b9ba4 [Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038) ...

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

2024-10-06 12:48:11 -07:00

..

__init__.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

interfaces.py

[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038)

2024-10-06 12:48:11 -07:00

multi_step.py

[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038)

2024-10-06 12:48:11 -07:00

single_step.py

[Bugfix] Fix single output condition in output processor (#7881)

2024-09-02 20:35:42 -07:00

stop_checker.py

[mypy] Enable following imports for entrypoints (#7248)

2024-08-20 23:28:21 -07:00

util.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00