[OCP MX ] Add back emulation to available OCP MX backends list (#46629)
Signed-off-by: Felix Marty <Felix.Marty@amd.com> Co-authored-by: Andreas Karatzas <akaratza@amd.com>
This commit is contained in:
co-authored by
Andreas Karatzas
parent
4b643c463e
commit
03c6d01c30
@@ -319,6 +319,7 @@ def _get_priority_backends_for_gpt_oss() -> list[Mxfp4MoeBackend]:
|
||||
Mxfp4MoeBackend.MARLIN,
|
||||
Mxfp4MoeBackend.BATCHED_MARLIN,
|
||||
Mxfp4MoeBackend.XPU,
|
||||
Mxfp4MoeBackend.EMULATION,
|
||||
]
|
||||
return _AVAILABLE_BACKENDS
|
||||
|
||||
@@ -554,8 +555,6 @@ def select_mxfp4_moe_backend(
|
||||
f"weight_key=kMxfp4Static, activation_key={activation_key}. "
|
||||
"Native backends require specific hardware. "
|
||||
"Set `VLLM_LOGGING_LEVEL=DEBUG` to see detailed unsupported reasons. "
|
||||
"To use the emulation backend for research/debugging, pass "
|
||||
"--moe-backend emulation."
|
||||
)
|
||||
|
||||
return Mxfp4MoeBackend.NONE, None
|
||||
|
||||
Reference in New Issue
Block a user