Nick Hill 30172b4947 [V1] Optimize handling of sampling metadata and req_ids list (#13244) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-02-18 12:15:33 -08:00

..

__init__.py

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394)

2024-12-27 09:32:38 +09:00

penalties.py

[V1] Optimize handling of sampling metadata and req_ids list (#13244)

2025-02-18 12:15:33 -08:00

topk_topp_sampler.py

[V1] Optimize handling of sampling metadata and req_ids list (#13244)

2025-02-18 12:15:33 -08:00