[CI] Select the supported DCP backend for PCP eval (#56677)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
This commit is contained in:
@@ -11,6 +11,7 @@ server_args: >-
|
|||||||
--moe-backend flashinfer_cutlass
|
--moe-backend flashinfer_cutlass
|
||||||
--prefill-context-parallel-size 4
|
--prefill-context-parallel-size 4
|
||||||
--decode-context-parallel-size 4
|
--decode-context-parallel-size 4
|
||||||
|
--dcp-comm-backend ag_rs
|
||||||
--enable-expert-parallel
|
--enable-expert-parallel
|
||||||
--kv-cache-dtype fp8
|
--kv-cache-dtype fp8
|
||||||
env:
|
env:
|
||||||
|
|||||||
Reference in New Issue
Block a user