JohnQinAMDandTJian ed7fe831da [ROCm] Enable the aiter top-k/top-p sampler by default (#43331) ...

Signed-off-by: John Qin <yanyuan.qin@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

2026-05-28 13:19:59 -05:00

..

__init__.py

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394)

2024-12-27 09:32:38 +09:00

bad_words.py

[Perf][1/n] Eliminate various GPU<->CPU syncs (#41429)

2026-05-11 20:36:03 +00:00

logprobs.py

[Performance Improvement] Update batched_count_greater_than to handle batch size 1 without recompile (#38933)

2026-04-09 23:51:31 +08:00

penalties.py

[BugFix] Fix mixed penalties batch with async scheduling (#27910)

2025-11-01 10:51:24 -07:00

topk_topp_sampler.py

[ROCm] Enable the aiter top-k/top-p sampler by default (#43331)

2026-05-28 13:19:59 -05:00

topk_topp_triton.py

[Bugfix] Fix native Triton top-k/top-p kernel assumes contiguous logi… (#42739)

2026-05-22 22:56:16 -07:00