3 people a3ed5ab10c [KV Offload] Add per-request offloading policy via on_new_request lifecycle hook (#43205) ...

Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-05-28 20:45:18 +00:00

..

device_communicators

[ROCm] mori: add InterNodeV1LL inter-node kernel selection via VLLM_MORI_INTERNODE_KERNEL (#41751)

2026-05-28 00:33:32 +08:00

ec_transfer

[EC Connector] Add shutdown API to EC Connector. (#42423)

2026-05-28 12:28:01 +00:00

elastic_ep

elastic_ep: stage/commit MoE quant method on reconfigure (#40881)

2026-05-22 18:57:26 -04:00

eplb

[RFC][EPLB][#32028] Remove dead torch.accelerator.synchronize() from sync path (#40733)

2026-05-22 15:19:24 -04:00

kv_transfer

[KV Offload] Add per-request offloading policy via on_new_request lifecycle hook (#43205)

2026-05-28 20:45:18 +00:00

weight_transfer

Add model to WeightTransferEngine.__init__ (#42922)

2026-05-22 17:52:15 -07:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

communication_op.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

feat(kv-events): emit KV cache metadata (#40984)

2026-05-12 15:58:48 +00:00

nixl_utils.py

[EPLB] Change default EPLB communicator (#43110)

2026-05-22 09:43:27 -04:00

parallel_state.py

[Feature] Add --cpu-distributed-timeout-seconds CLI Option for CPU Process Group Timeout (#42968)

2026-05-21 15:42:07 -07:00

stateless_coordinator.py

elastic_ep: Fix stateless group port races (#36330)

2026-03-18 14:36:18 +00:00

utils.py

[Feature] Add --cpu-distributed-timeout-seconds CLI Option for CPU Process Group Timeout (#42968)

2026-05-21 15:42:07 -07:00