Lucas KabelaandLuka Govedič a8c6ee9b78 [Performance Improvement] Update batched_count_greater_than to handle batch size 1 without recompile (#38933) ...

Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2026-04-09 23:51:31 +08:00

..

__init__.py

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394)

2024-12-27 09:32:38 +09:00

bad_words.py

[BugFix] Fix bad words with speculative decoding (#31908)

2026-01-07 15:46:42 -05:00

logprobs.py

[Performance Improvement] Update batched_count_greater_than to handle batch size 1 without recompile (#38933)

2026-04-09 23:51:31 +08:00

penalties.py

[BugFix] Fix mixed penalties batch with async scheduling (#27910)

2025-11-01 10:51:24 -07:00

topk_topp_sampler.py

remove cuda check in top_k_top_p_triton kernel (#35011)

2026-02-24 22:22:31 -08:00

topk_topp_triton.py

[Perf] Optimize top-k search in apply_top_k_top_p_triton sampler (#37225)

2026-03-17 11:35:17 -07:00