Woosuk Kwon 5fcb0cdd68 [Model Runner V2] Use FP32 for Gumbel Noise (#34854) ...

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

2026-02-18 17:07:37 -08:00

..

__init__.py

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

2025-11-29 00:41:01 -08:00

bad_words.py

[Model Runner V2] Minor refactoring for penalties (#34662)

2026-02-16 21:43:00 -08:00

gumbel.py

[Model Runner V2] Use FP32 for Gumbel Noise (#34854)

2026-02-18 17:07:37 -08:00

logit_bias.py

[ModelRunner V2] Misc minor simplifications and optimizations (#33467)

2026-02-01 22:17:14 +00:00

logprob.py

[ModelRunner V2] Revert token rank comparison difference for now (#34017)

2026-02-07 11:11:05 +08:00

min_p.py

[ModelRunner V2] Misc minor simplifications and optimizations (#33467)

2026-02-01 22:17:14 +00:00

output.py

[Model Runner V2] Support num NaNs in logits (#30187)

2025-12-09 10:00:49 -08:00

penalties.py

[Model Runner V2] Minor refactoring for penalties (#34662)

2026-02-16 21:43:00 -08:00

prompt_logprob.py

[Model Runner V2] support bad_words sampling param (#33433)

2026-02-16 16:36:06 -08:00

sampler.py

[Model Runner V2] Minor refactoring for penalties (#34662)

2026-02-16 21:43:00 -08:00

states.py

[Model Runner V2] Minor cleanup for Sampler (#34563)

2026-02-14 18:29:03 -08:00