[CI] Stabilize memory-sensitive compile and structured output tests (#49749)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com> Co-authored-by: OpenAI Codex <noreply@openai.com>
This commit is contained in:
co-authored by
OpenAI Codex
parent
972848f276
commit
9e6746b3c7
@@ -64,6 +64,8 @@ class TestSetting:
|
||||
"bfloat16",
|
||||
"--max-model-len",
|
||||
"2048",
|
||||
"--gpu-memory-utilization",
|
||||
"0.98",
|
||||
],
|
||||
pp_size=1,
|
||||
tp_size=1,
|
||||
|
||||
Reference in New Issue
Block a user