alberto 75dc588269 [KV Offload] Add per-request max_load_tokens control (#55885) ...

Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>

2026-09-16 06:57:38 +03:00

..

device_communicators

[ROCm][Bugfix] Fix elastic EP scaling deadlock (#56610)

2026-09-12 23:09:19 +00:00

ec_transfer

[CI] Add e2e test for scale-out EC connector flow (#54973)

2026-09-09 07:38:32 -07:00

elastic_ep

[ROCm][Bugfix] Fix elastic EP scaling deadlock (#56610)

2026-09-12 23:09:19 +00:00

eplb

[Elastic EP] Reuse CUDA graphs across reconfiguration (#54985)

2026-09-12 10:26:39 -04:00

kv_transfer

[KV Offload] Add per-request max_load_tokens control (#55885)

2026-09-16 06:57:38 +03:00

weight_transfer

[ROCm][Bugfix] Initialize Ray NIXL agents for sharded RDT (#56687)

2026-09-15 00:34:21 +00:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

communication_op.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

[Core][KV Events] Echo session_id on GPU BlockStored events (#51381)

2026-09-04 02:22:50 +00:00

nixl_utils.py

[ROCm][Bugfix] Initialize Ray NIXL agents for sharded RDT (#56687)

2026-09-15 00:34:21 +00:00

parallel_state.py

[DS V4.1][Engram] Support async prefetch for offloaded engram lookups and engram DP sharding (#56512)

2026-09-13 02:44:23 -07:00

stateless_coordinator.py

[Elastic EP] Async preparation (#47288)

2026-07-28 05:19:13 -07:00

utils.py

fix(distributed): propagate distributed_timeout_seconds to NCCL device groups (#45159)

2026-07-07 02:52:51 +00:00