Artem Perevedentsev b92ef9ec5a [Perf] Enable FlashInfer top-k/top-p sampler by default (#40376) ...

Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>

2026-04-29 19:10:34 +04:00

..

__init__.py

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394)

2024-12-27 09:32:38 +09:00

bad_words.py

[BugFix] Fix bad words with speculative decoding (#31908)

2026-01-07 15:46:42 -05:00

logprobs.py

[Performance Improvement] Update batched_count_greater_than to handle batch size 1 without recompile (#38933)

2026-04-09 23:51:31 +08:00

penalties.py

[BugFix] Fix mixed penalties batch with async scheduling (#27910)

2025-11-01 10:51:24 -07:00

topk_topp_sampler.py

[Perf] Enable FlashInfer top-k/top-p sampler by default (#40376)

2026-04-29 19:10:34 +04:00

topk_topp_triton.py

[Perf] Optimize top-k search in apply_top_k_top_p_triton sampler (#37225)

2026-03-17 11:35:17 -07:00