[Doc] add backend to doc string of initialize_model_parallel (#22142)

Signed-off-by: Andy Xie <andy.xning@gmail.com>
2025-08-04 19:36:20 -07:00
parent 7b455cf1c0
commit 29b97c0995
1 changed files with 1 additions and 0 deletions
@@ -1013,6 +1013,7 @@ def initialize_model_parallel(
            parallelism.
        pipeline_model_parallel_size: number of GPUs used for pipeline model
            parallelism.
+        backend: name of torch distributed communication backend.

    Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we
    use 2 GPUs to parallelize the model tensor, and 4 GPUs to parallelize