[ROCm][CI] Increase the max wait time for server startup (#46417)
Signed-off-by: charlifu <charlifu@amd.com>
This commit is contained in:
@@ -3,6 +3,7 @@ accuracy_threshold: 0.89
|
|||||||
tolerance: 0.03
|
tolerance: 0.03
|
||||||
num_questions: 1319
|
num_questions: 1319
|
||||||
num_fewshot: 5
|
num_fewshot: 5
|
||||||
|
startup_max_wait_seconds: 1800
|
||||||
server_args: >-
|
server_args: >-
|
||||||
--max-model-len 4096
|
--max-model-len 4096
|
||||||
--tensor-parallel-size 2
|
--tensor-parallel-size 2
|
||||||
|
|||||||
Reference in New Issue
Block a user