youkaichao bf53e0c70b Support torchrun and SPMD-style offline inference (#12071) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>

2025-01-16 19:58:53 +08:00

..

__init__.py

…

test_ca_buffer_sharing.py

[distributed] add function to create ipc buffers directly (#10064)

2024-11-05 22:35:03 -08:00

test_comm_ops.py

…

test_custom_all_reduce.py

[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233)

2025-01-04 14:50:16 +08:00

test_distributed_oot.py

…

test_multi_node_assignment.py

[Ray backend] Better error when pg topology is bad. (#7584)

2024-08-22 17:44:25 -07:00

test_pipeline_parallel.py

[Model] Refactor Ultravox to use merged input processor (#11198)

2024-12-16 10:09:53 +00:00

test_pipeline_partition.py

…

test_pp_cudagraph.py

…

test_pynccl.py

[distributed] remove pynccl's redundant change_state (#11749)

2025-01-06 09:05:48 +08:00

test_same_node.py

[core][distributed] initialization from StatelessProcessGroup (#10986)

2024-12-12 09:04:19 +00:00

test_shm_broadcast.py

[core][distributed] initialization from StatelessProcessGroup (#10986)

2024-12-12 09:04:19 +00:00

test_torchrun_example.py

Support torchrun and SPMD-style offline inference (#12071)

2025-01-16 19:58:53 +08:00

test_utils.py

custom allreduce + torch.compile (#10121)

2024-11-25 22:00:16 -08:00