[DSv4 Bug] fix dsv4 start up error NotImplementedError: DeepSeek V4 MegaMoE currently requires expert parallel (#55914)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
@@ -1746,6 +1746,7 @@ class SpeculativeConfig:
|
||||
draft_parallel_config = ParallelConfig(
|
||||
pipeline_parallel_size=1,
|
||||
tensor_parallel_size=speculative_draft_tensor_parallel_size,
|
||||
enable_expert_parallel=target_parallel_config.enable_expert_parallel,
|
||||
distributed_executor_backend=target_parallel_config.distributed_executor_backend,
|
||||
max_parallel_loading_workers=target_parallel_config.max_parallel_loading_workers,
|
||||
disable_custom_all_reduce=target_parallel_config.disable_custom_all_reduce,
|
||||
|
||||
Reference in New Issue
Block a user