[Model Runner V2] Support custom logits processors (#56497)

Signed-off-by: David Cheung <d7cheung@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
This commit is contained in:
David Cheung
2026-09-19 17:46:49 +00:00
committed by GitHub
co-authored by Claude Nick Hill
parent 751f6807d9
commit 5302d1fe40
32 changed files with 1215 additions and 510 deletions
@@ -85,6 +85,7 @@ def _validate(enable_trace_replay: bool) -> None:
speculative_config=None,
structured_outputs_config=None,
tokenizer=None,
validate_logits_processors_params=lambda params: None,
)
params = SamplingParams(trace_decode_token_ids=[1, 2, 3])
with patch.object(SamplingParams, "verify"):