[Distributed][MoonEP] BF16 integration of MoonEP balanced EP backend (#52101)
Signed-off-by: kevinli <306243285+kaijunli-infr@users.noreply.github.com> Co-authored-by: kevinli <306243285+kaijunli-infr@users.noreply.github.com>
This commit is contained in:
@@ -49,6 +49,7 @@ All2AllBackend = Literal[
|
||||
"deepep_v2",
|
||||
"mori_high_throughput",
|
||||
"mori_low_latency",
|
||||
"moonep",
|
||||
"nixl_ep",
|
||||
"allgather_reducescatter",
|
||||
"flashinfer_all2allv", # temporary alias for flashinfer_nvlink_two_sided
|
||||
@@ -206,6 +207,7 @@ class ParallelConfig:
|
||||
- "deepep_low_latency": Use deepep low-latency kernels
|
||||
- "mori_high_throughput": MoRI EP with InterNodeV1 for multi-node
|
||||
- "mori_low_latency": MoRI EP with InterNodeV1LL for multi-node
|
||||
- "moonep": MoonEP balanced EP with dynamic redundant experts (NVLink)
|
||||
- "nixl_ep": Use nixl-ep kernels
|
||||
- "flashinfer_nvlink_one_sided": Use flashinfer high-throughput a2a kernels
|
||||
- "flashinfer_nvlink_two_sided": Use flashinfer two-sided kernels for mnnvl"""
|
||||
|
||||
Reference in New Issue
Block a user