Johnny Yang ba1fcd84a7 [TPU] add tpu_inference (#27277) ...

Signed-off-by: Johnny Yang <johnnyyang@google.com>

2025-11-26 14:46:36 -08:00

..

__init__.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

all2all.py

[Refactor] Remove VLLM_DEEPEP_LOW_LATENCY_ALLOW_NVLINK (#27750)

2025-10-30 15:32:39 -04:00

all_reduce_utils.py

[Chore] Separate out system utilities from vllm.utils (#27201)

2025-10-22 20:25:25 +00:00

base_device_communicator.py

[Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123)

2025-11-04 21:59:45 +08:00

cpu_communicator.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

cuda_communicator.py

[Log] Optimize Startup Log (#26740)

2025-10-24 19:27:04 -04:00

cuda_wrapper.py

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695)

2025-11-12 15:24:12 -08:00

custom_all_reduce.py

[Log] Optimize Startup Log (#26740)

2025-10-24 19:27:04 -04:00

mnnvl_compat.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

pynccl_allocator.py

[Chore] Separate out NCCL utilities from vllm.utils (#27197)

2025-10-21 06:18:23 -07:00

pynccl_wrapper.py

[Chore] Separate out NCCL utilities from vllm.utils (#27197)

2025-10-21 06:18:23 -07:00

pynccl.py

[Log] Optimize Startup Log (#26740)

2025-10-24 19:27:04 -04:00

quick_all_reduce.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

ray_communicator.py

[Misc] Avoid "PyTorch non-writable tensors" warning in RayPPCommunicator (#27443)

2025-10-24 14:53:09 +08:00

shm_broadcast.py

[V1] Support MP Executor for multi node distributed inference (#23691)

2025-11-16 09:01:21 +00:00

shm_object_storage.py

[BugFix] Fix multi-modal async scheduling race condition (#28706)

2025-11-14 01:11:13 -08:00

symm_mem.py

Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483)

2025-11-26 22:27:26 +08:00

tpu_communicator.py

[TPU] add tpu_inference (#27277)

2025-11-26 14:46:36 -08:00

xpu_communicator.py

[UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732)

2025-10-13 18:12:52 -07:00