[Bugfix][Ray] Fix RayExecutorV2 actor name collision with DP > 1 (#40398)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
This commit is contained in:
@@ -403,6 +403,11 @@ class CoreEngineActorManager:
|
|||||||
range(dp_size), local_dp_ranks, placement_groups
|
range(dp_size), local_dp_ranks, placement_groups
|
||||||
):
|
):
|
||||||
dp_vllm_config = copy.deepcopy(vllm_config)
|
dp_vllm_config = copy.deepcopy(vllm_config)
|
||||||
|
if dp_size > 1:
|
||||||
|
# Append the DP rank to instance_id so that per-engine
|
||||||
|
# identifiers (e.g. Ray actor names in RayExecutorV2) are
|
||||||
|
# unique across DP replicas.
|
||||||
|
dp_vllm_config.instance_id = f"{dp_vllm_config.instance_id}_dp{index}"
|
||||||
dp_vllm_config.parallel_config.placement_group = pg
|
dp_vllm_config.parallel_config.placement_group = pg
|
||||||
local_client = index < local_engine_count
|
local_client = index < local_engine_count
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user