[MoE Refactor] Add more MoE layer tests (#39349)
Signed-off-by: Bill Nell <bnell@redhat.com> Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
This commit is contained in:
@@ -990,8 +990,7 @@ class FusedMoEParallelConfig:
|
||||
|
||||
@property
|
||||
def use_batched_activation_format(self):
|
||||
# TODO(bnell): nixl also uses batched format
|
||||
return self.use_deepep_ll_kernels
|
||||
return self.use_deepep_ll_kernels or self.use_nixl_ep_kernels
|
||||
|
||||
@property
|
||||
def use_ag_rs_all2all_kernels(self):
|
||||
|
||||
Reference in New Issue
Block a user