[Bugfix][OpenAI] Respect allowed_token_ids in beam search (#47630)

Signed-off-by: Ting Sun <suntcrick@gmail.com>
This commit is contained in:
Ting SUN
2026-10-17 08:50:40 +00:00
committed by GitHub
parent b05ede5616
commit eb8de8d1a1
6 changed files with 185 additions and 13 deletions
@@ -334,6 +334,7 @@ class CompletionRequest(OpenAIBaseModel):
return BeamSearchParams(
beam_width=n,
allowed_token_ids=self.allowed_token_ids,
max_tokens=max_tokens,
ignore_eos=self.ignore_eos,
temperature=temperature,