Ren Yuzhou 7b94293627 [Bugfix][ROCm][KV Offload] Use private pinned tensors for CPU KV offload (#57160) ...

Signed-off-by: Yuzhou Ren <ryzcqu@outlook.com>

2026-09-18 02:35:23 +00:00

..

policies

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

__init__.py

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into cpu/ package (#37874)

2026-03-24 07:02:51 +02:00

common.py

[Refactor][kv_offload]: rename block→chunk (#52615)

2026-09-09 17:45:49 +03:00

gpu_worker.py

[Bugfix][KV Offload] Register the offload region in chunks (#51081)

2026-09-17 13:19:56 +03:00

manager.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

shared_offload_region.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

spec.py

[Bugfix][ROCm][KV Offload] Use private pinned tensors for CPU KV offload (#57160)

2026-09-18 02:35:23 +00:00

swap_blocks_triton.py

[Perf] Triton fast path for small CPU→GPU swap_blocks_batch in the offloading connector (#42212)

2026-06-03 13:38:17 +03:00