[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286)
Signed-off-by: Yifan Zong <yzong@redhat.com> Signed-off-by: Robert Shaw <robshaw@redhat.com> Signed-off-by: yzong-rh <yzong@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Robert Shaw <robshaw@redhat.com>
This commit is contained in:
co-authored by
Robert Shaw
Robert Shaw
parent
598190aac3
commit
d9b90a07ac
@@ -202,6 +202,7 @@ def has_flashinfer_trtllm_fused_moe() -> bool:
|
||||
("flashinfer.fused_moe", "trtllm_fp8_per_tensor_scale_moe"),
|
||||
("flashinfer.fused_moe", "trtllm_fp4_block_scale_moe"),
|
||||
("flashinfer.fused_moe", "trtllm_mxint4_block_scale_moe"),
|
||||
("flashinfer.fused_moe", "trtllm_bf16_moe"),
|
||||
]
|
||||
for module_name, attr_name in required_functions:
|
||||
mod = _get_submodule(module_name)
|
||||
|
||||
Reference in New Issue
Block a user