[Misc] Misc code cleanup/simplification (#23304)

Signed-off-by: Nick Hill <nhill@redhat.com>
This commit is contained in:
Nick Hill
2025-08-21 17:22:55 +00:00
committed by GitHub
parent 10f535c086
commit 603fbbbce0
4 changed files with 51 additions and 57 deletions
+1 -1
View File
@@ -91,7 +91,7 @@ class Sampler(nn.Module):
logits = self.apply_bad_words(logits, sampling_metadata)
# Apply logits processors which can impact greedy sampling
for processor in (sampling_metadata.logitsprocs.non_argmax_invariant):
for processor in sampling_metadata.logitsprocs.non_argmax_invariant:
logits = processor.apply(logits)
# Apply penalties (e.g., min_tokens, freq_penalties).