Cheng RuiandRui Rui4 Cheng 6664d397bf [Performance][MRV2] Cache logits-processing request state (#52329) ...

Signed-off-by: Rui Rui4 Cheng <chengrui4@lenovo.com>
Co-authored-by: Rui Rui4 Cheng <chengrui4@lenovo.com>

2026-08-17 02:36:41 +00:00

..

__init__.py

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

2025-11-29 00:41:01 -08:00

bad_words.py

[Bugfix][Model Runner V2][Spec Decode] Fix off-by-one in bad_words draft-prefix matching (#52311)

2026-08-16 09:02:20 +00:00

gumbel.py

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

2026-08-05 19:12:46 -07:00

logit_bias.py

Revert "[Sampler] Stop upcasting logits to fp32 in apply_sampling_params" (#48641) (#49033)

2026-07-21 09:36:45 +01:00

logprob.py

[Bugfix][V1/V2] Fix prompt_logprobs to respect logprobs_mode (#47680)

2026-07-17 21:58:59 +01:00

min_p.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)

2026-06-24 11:00:57 -07:00

output.py

[Feature] Mask Replay (#49577)

2026-08-13 08:44:31 +00:00

penalties.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)

2026-06-24 11:00:57 -07:00

prompt_logprob.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

sampler.py

[Performance][MRV2] Cache logits-processing request state (#52329)

2026-08-17 02:36:41 +00:00

states.py

[Model Runner V2] Fix openai.InternalServerError: Error code: 500 - 'list index out of range' (#45467)

2026-06-13 01:44:16 -07:00

thinking_budget.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00