Chang GuoandCursor Agent 542a8fad6d [KV Offload] Move CPUOffloadingSpec onto SharedOffloadRegion (#50094) ...

Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: Cursor Agent <cursor-agent@cursor.com>

2026-07-29 13:05:50 +03:00

..

policies

Add CachePolicyFactory for pluggable/external eviction policies (#49114)

2026-07-29 07:34:55 +03:00

__init__.py

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into cpu/ package (#37874)

2026-03-24 07:02:51 +02:00

common.py

[KV Offload] Split cpu_cache_usage_perc into write/read usage gauges (#47666)

2026-07-14 20:13:41 +03:00

gpu_worker.py

[Bugfix][ROCm] Use batch DMA for CPU KV cache loads (#49843)

2026-07-27 02:18:01 -07:00

manager.py

Add CachePolicyFactory for pluggable/external eviction policies (#49114)

2026-07-29 07:34:55 +03:00

shared_offload_region.py

Make tiering offload region DP-replica aware (#47987)

2026-07-12 13:10:21 +03:00

spec.py

[KV Offload] Move CPUOffloadingSpec onto SharedOffloadRegion (#50094)

2026-07-29 13:05:50 +03:00

swap_blocks_triton.py

[Perf] Triton fast path for small CPU→GPU swap_blocks_batch in the offloading connector (#42212)

2026-06-03 13:38:17 +03:00