Lucas Kabela 4e498b5e5c [Bugfix][Performance Improvement] Improve penalties triton kernel performance (#40657) ...

Signed-off-by: Lucas Kabela <lucaskabela@meta.com>

2026-05-12 05:47:20 +00:00

..

__init__.py

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

2025-11-29 00:41:01 -08:00

bad_words.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00

gumbel.py

[Model Runner V2] Rebuild attn metadata between draft decode steps (#41162)

2026-05-05 00:44:55 +00:00

logit_bias.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00

logprob.py

[Model Runner V2] Bug fix: logprob dtype int64/int32 issue (#41761)

2026-05-11 21:55:43 +00:00

min_p.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00

output.py

[Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461)

2026-03-11 14:04:32 -07:00

penalties.py

[Bugfix][Performance Improvement] Improve penalties triton kernel performance (#40657)

2026-05-12 05:47:20 +00:00

prompt_logprob.py

[bugfix] Fix prompt logprobs on request eviction during chunked prefill (#41411)

2026-05-04 11:46:00 -07:00

sampler.py

[Bugfix][Performance Improvement] Improve penalties triton kernel performance (#40657)

2026-05-12 05:47:20 +00:00

states.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00