3 people 0f8fa53acf [Bugfix][KV Offload] Check cgroup memory before SHM allocation (#54014) ...

Signed-off-by: Alex <jihui.huang@daocloud.io>
Signed-off-by: AlexHuang <alex.tech.lab@outlook.com>
Signed-off-by: Alex <alex.tech.lab@outlook.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>

2026-09-16 09:17:50 +03:00

..

__init__.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

aiter_custom_all_reduce.py

[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)

2026-09-11 13:19:57 +08:00

all2all.py

[Elastic EP] Reuse CUDA graphs across reconfiguration (#54985)

2026-09-12 10:26:39 -04:00

all_reduce_utils.py

[Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606)

2026-08-26 01:46:56 +00:00

base_device_communicator.py

[Elastic EP] Reuse CUDA graphs across reconfiguration (#54985)

2026-09-12 10:26:39 -04:00

cpu_communicator.py

[Elastic EP] Async preparation (#47288)

2026-07-28 05:19:13 -07:00

cuda_communicator.py

[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)

2026-09-11 13:19:57 +08:00

cuda_wrapper.py

[Bugfix][ROCm] Fix cumem sleep and teardown (#46203)

2026-06-24 02:45:31 +08:00

custom_all_reduce.py

[Model] Support Qwen3.8-Flash-Next (#53896)

2026-08-31 05:57:56 +00:00

flashinfer_all_reduce.py

[Misc] Log FlashInfer allreduce workspace init failure as error (#55127)

2026-09-11 09:35:56 +00:00

flashinfer_pcie_ipc_all_reduce.py

[Distributed] Add opt-in FlashInfer PCIe IPC all-reduce backend (#53576)

2026-09-01 03:34:56 +00:00

mnnvl_compat.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

pynccl_allocator.py

[WideEP] Update NCCL to 2.30.7 to enable DeepEPv2 in the vllm/vllm-openai image (#45321)

2026-07-24 13:00:02 -07:00

pynccl_wrapper.py

[Distributed] Support pre-shared ncclUniqueId rendezvous for weight transfer (#53784)

2026-09-01 14:55:57 +08:00

pynccl.py

[ROCm][Bugfix] Fix elastic EP scaling deadlock (#56610)

2026-09-12 23:09:19 +00:00

quick_all_reduce.py

[ROCM] [Communication] Add INT3 quantization method for quickreduce (#45666)

2026-06-25 15:14:15 +00:00

ray_communicator.py

[Misc] Avoid "PyTorch non-writable tensors" warning in RayPPCommunicator (#27443)

2025-10-24 14:53:09 +08:00

shm_broadcast.py

[Bugfix][KV Offload] Check cgroup memory before SHM allocation (#54014)

2026-09-16 09:17:50 +03:00

shm_object_storage.py

[CI] Bump mypy version to 1.19.1 (#36104)

2026-03-10 09:18:28 -07:00

symm_mem.py

[Rubin] Enable NVLink all-reduce paths on SM107 (#49647)

2026-07-29 20:53:25 +00:00

xpu_communicator.py

[Elastic EP] Async preparation (#47288)

2026-07-28 05:19:13 -07:00