[Bugfix] Fix vllm bench ... on CPU-only head nodes (#25283)

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
This commit is contained in:
Aydin Abiar
2025-10-08 16:06:42 +00:00
committed by GitHub
co-authored by Aydin Abiar Harry Mellor Wentao Ye
parent c1b06fc182
commit 76afe4edf8
3 changed files with 34 additions and 0 deletions
+3
View File
@@ -141,6 +141,9 @@ class Platform:
def is_out_of_tree(self) -> bool:
return self._enum == PlatformEnum.OOT
def is_unspecified(self) -> bool:
return self._enum == PlatformEnum.UNSPECIFIED
def get_max_output_tokens(self, prompt_len: int) -> int:
return sys.maxsize