SangBin Cho 603ad84815 [Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

..

__init__.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

interfaces.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

multi_step.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

single_step.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

stop_checker.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

util.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00