aoshen02 bd5bbce6e4 [RL] Release weight-transfer communicators without stopping inference (#61060) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: fh3 <a@b>

2026-10-11 21:15:14 +08:00

..

aux_output_connector

[Bugfix][DSv4.1] Skip SWA bounded replay for KV loads that carry the window (#59197)

2026-10-07 15:28:42 -07:00

device_communicators

[Core] Release FlashInfer allreduce workspace with --enable-nccl-comm-suspend (#59360)

2026-10-10 02:26:40 +00:00

ec_transfer

[Bugfix][EC Connector] Release shared memory on NIXL setup failure (#59875)

2026-10-08 17:38:16 -07:00

elastic_ep

[ModelRunner V2] Speculative Decoding NGram GPU Implementations (#40704)

2026-10-06 13:32:59 -07:00

eplb

[Bugfix][EPLB] Use group-local ranks for torch P2P transfers (#55804)

2026-10-06 07:44:57 +00:00

kv_transfer

[Bugfix][Mooncake] Use the EAGLE replay boundary when retaining sliding-window tails (#61012)

2026-10-11 09:15:18 +00:00

weight_transfer

[RL] Release weight-transfer communicators without stopping inference (#61060)

2026-10-11 21:15:14 +08:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

communication_op.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

[Core][BugFix] Tag prefix-cache extra keys by source (#51899)

2026-09-29 18:24:59 -07:00

mooncake_store.py

[Feature][Multimodal] Add cross-encoder caching to Mooncake P2P (#56242)

2026-09-17 13:16:41 +08:00

nixl_utils.py

[ROCm][Bugfix] Initialize Ray NIXL agents for sharded RDT (#56687)

2026-09-15 00:34:21 +00:00

parallel_state.py

[sharded state loader] support pp in sharded state loader (#52110)

2026-10-09 11:08:31 -07:00

stateless_coordinator.py

[Bugfix][FT] Pass stateless process-group timeouts explicitly (#58611)

2026-09-29 03:14:02 +00:00

utils.py

Remove Python 3.10 support now that it is EOL (#60402)

2026-10-08 02:30:52 -07:00