3 people 9e88e969c0 [Perf][KVConnector][Mooncake] Parallelize KV load with a receive-thread pool (#45971) ...

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-06-24 18:25:12 -07:00

..

device_communicators

[Bugfix][ROCm] Fix cumem sleep and teardown (#46203)

2026-06-24 02:45:31 +08:00

ec_transfer

[EC Connector] Non blocking EC Connector lookup (#41627)

2026-06-02 08:48:25 +00:00

elastic_ep

[EPLB] Enable nixl eplb communicator for elastic ep (#45013)

2026-06-22 10:54:08 -07:00

eplb

[EPLB] Enable nixl eplb communicator for elastic ep (#45013)

2026-06-22 10:54:08 -07:00

kv_transfer

[Perf][KVConnector][Mooncake] Parallelize KV load with a receive-thread pool (#45971)

2026-06-24 18:25:12 -07:00

weight_transfer

[Frontend][Core] Add sparse NCCL weight transfer support for in-place updates (#40096)

2026-06-01 15:37:30 -04:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

communication_op.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

[KV Events] Switch event structs from array to map encoding (#42892)

2026-06-09 11:39:52 +00:00

nixl_utils.py

[EPLB] Change default EPLB communicator (#43110)

2026-05-22 09:43:27 -04:00

parallel_state.py

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

stateless_coordinator.py

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

utils.py

[EPLB] Nixl communicator optimization. Zero-copy transfers (#41633)

2026-06-04 03:40:34 +00:00