youkaichaoandCody Yu d9a252bc8e [Core][Distributed] add shm broadcast (#5399) ...

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-06-21 05:12:35 +00:00

..

__init__.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

cuda_wrapper.py

[Core][Distributed] improve p2p cache generation (#5528)

2024-06-14 14:47:45 -07:00

custom_all_reduce_utils.py

[distributed][misc] use fork by default for mp (#5669)

2024-06-20 17:06:34 -07:00

custom_all_reduce.py

Add cuda_device_count_stateless (#5473)

2024-06-13 16:06:49 -07:00

pynccl_wrapper.py

[mypy] Enable type checking for test directory (#5017)

2024-06-15 04:45:31 +00:00

pynccl.py

[Core][Distributed] code deduplication in tp&pp with coordinator(#5293)

2024-06-12 17:27:08 -07:00

shm_broadcast.py

[Core][Distributed] add shm broadcast (#5399)

2024-06-21 05:12:35 +00:00