Almog TavorandOr Ozeri dc02934a07 [Bugfix][KV Offload] Stop offloading the final sampled token's KV slot (#54288) ...

Signed-off-by: almogtavor <almogtavor@gmail.com>
Signed-off-by: Almog Tavor <70065337+almogtavor@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>

2026-09-06 15:22:19 +03:00

..

device_communicators

[Distributed] Support pre-shared ncclUniqueId rendezvous for weight transfer (#53784)

2026-09-01 14:55:57 +08:00

ec_transfer

[EC Connector] P2P NIXL + CPU EC Connector (#47941)

2026-09-04 11:23:56 +08:00

elastic_ep

[Elastic EP] Reduce eager-mode reconfiguration downtime (#51885)

2026-08-19 02:13:06 +00:00

eplb

[Perf] Ensure async h2d copies are pinned in more places (#55202)

2026-09-04 17:17:01 -07:00

kv_transfer

[Bugfix][KV Offload] Stop offloading the final sampled token's KV slot (#54288)

2026-09-06 15:22:19 +03:00

weight_transfer

[Distributed] Support pre-shared ncclUniqueId rendezvous for weight transfer (#53784)

2026-09-01 14:55:57 +08:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

communication_op.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

[Core][KV Events] Echo session_id on GPU BlockStored events (#51381)

2026-09-04 02:22:50 +00:00

nixl_utils.py

[ROCm] Upgrade NIXL and UCX (#49251)

2026-07-21 22:30:02 -05:00

parallel_state.py

[Core] Release NCCL communicator memory in sleep mode (#51485)

2026-09-01 14:31:16 +08:00

stateless_coordinator.py

[Elastic EP] Async preparation (#47288)

2026-07-28 05:19:13 -07:00

utils.py

fix(distributed): propagate distributed_timeout_seconds to NCCL device groups (#45159)

2026-07-07 02:52:51 +00:00