[Bugfix] Properly set distributed_executor_backend in ParallelConfig (#4816)

This commit is contained in:
zifeitong
2024-05-15 07:22:09 -07:00
committed by GitHub
parent e9cdd2b1e2
commit a5675d348b
2 changed files with 8 additions and 3 deletions
+1
View File
@@ -531,6 +531,7 @@ class ParallelConfig:
If None, will use synchronous tokenization.
ray_workers_use_nsight: Whether to profile Ray workers with nsight, see
https://docs.ray.io/en/latest/ray-observability/user-guides/profiling.html#profiling-nsight-profiler.
placement_group: ray distributed model workers placement group.
distributed_executor_backend: Backend to use for distributed model
workers, either "ray" or "mp" (multiprocessing). If either
pipeline_parallel_size or tensor_parallel_size is greater than 1,