Nick Hill 989c176c0a [Perf][3/n] Eliminate GPU<->CPU syncs in attention impls (#41434) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-05-07 19:44:24 -07:00

..

__init__.py

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

2025-11-29 00:41:01 -08:00

bad_words.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00

gumbel.py

[Model Runner V2] Rebuild attn metadata between draft decode steps (#41162)

2026-05-05 00:44:55 +00:00

logit_bias.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00

logprob.py

[Model Runner V2] Add logprob_token_ids support (#40559)

2026-05-01 10:02:03 -07:00

min_p.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00

output.py

[Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461)

2026-03-11 14:04:32 -07:00

penalties.py

[Perf][3/n] Eliminate GPU<->CPU syncs in attention impls (#41434)

2026-05-07 19:44:24 -07:00

prompt_logprob.py

[bugfix] Fix prompt logprobs on request eviction during chunked prefill (#41411)

2026-05-04 11:46:00 -07:00

sampler.py

[Model Runner V2] Add logprob_token_ids support (#40559)

2026-05-01 10:02:03 -07:00

states.py

[ModelRunnerV2] Rename sampler functions and variables for clarity (#35459)

2026-03-02 19:48:56 -08:00