Tyler Michael Smith 28b3a1c7e5 [V1] Multiprocessing Tensor Parallel Support for v1 (#9856) ...

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

2024-12-10 06:28:14 +00:00

..

device_communicators

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

kv_transfer

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

__init__.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

communication_op.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)

2024-08-13 05:33:41 +00:00

parallel_state.py

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

utils.py

[core][distributed] use tcp store directly (#10275)

2024-11-12 17:36:08 -08:00