[CI] Select the supported DCP backend for PCP eval (#56677)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
This commit is contained in:
@@ -11,6 +11,7 @@ server_args: >-
|
||||
--moe-backend flashinfer_cutlass
|
||||
--prefill-context-parallel-size 4
|
||||
--decode-context-parallel-size 4
|
||||
--dcp-comm-backend ag_rs
|
||||
--enable-expert-parallel
|
||||
--kv-cache-dtype fp8
|
||||
env:
|
||||
|
||||
Reference in New Issue
Block a user