Peng GuanwenandMichael Goin f710fb5265 [Core] Use flashinfer sampling kernel when available (#7137) ...

Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-08-19 03:24:03 +00:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_beam_search.py

[CI/Test] improve robustness of test (vllm_runner) (#5357)

2024-06-08 08:59:20 +00:00

test_ignore_eos.py

[CI/Test] improve robustness of test (vllm_runner) (#5357)

2024-06-08 08:59:20 +00:00

test_logits_processor.py

[CI/Test] improve robustness of test (vllm_runner) (#5357)

2024-06-08 08:59:20 +00:00

test_logprobs.py

[Core] Reduce unnecessary compute when logprobs=None (#6532)

2024-07-29 16:47:31 +00:00

test_ranks.py

[CI/Test] improve robustness of test (vllm_runner) (#5357)

2024-06-08 08:59:20 +00:00

test_rejection_sampler.py

[SpecDecode] [Minor] Fix spec decode sampler tests (#7183)

2024-08-06 10:40:32 -07:00

test_sampler.py

[Core] Use flashinfer sampling kernel when available (#7137)

2024-08-19 03:24:03 +00:00

test_seeded_generate.py

[CI/Test] improve robustness of test (vllm_runner) (#5357)

2024-06-08 08:59:20 +00:00

test_typical_acceptance_sampler.py

[SpecDecode] [Minor] Fix spec decode sampler tests (#7183)

2024-08-06 10:40:32 -07:00