3 people f648eed23d [Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810) ...

Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Signed-off-by: Jared Wen <w13431838023@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

2026-09-20 10:58:55 +00:00

..

__init__.py

[Feat][v1] Simple yet General CPU KV Cache Offloading (#37160)

2026-03-31 17:58:37 -07:00

copy_backend.py

[Bugfix][KVConnector] Fix SimpleCPUOffloadConnector GPU->CPU store race (#46278)

2026-06-22 13:08:47 -07:00

cuda_mem_ops.py

[ROCm] Cpu offload for ROCm 7.13+ to align the hipMemcpyBatchAsync params and perf in 7.14x (#43018)

2026-08-21 09:07:03 -07:00

disk_backend.py

[Bugfix][KV Connector] Only enforce disk block alignment for O_DIRECT (#55424)

2026-09-11 13:12:59 -07:00

manager.py

[Bugfix][KV Offload] Skip non-prefix-cacheable groups in SimpleCPUOffload (GLM-5.3-Flash kpool tail and QSA) (#56810)

2026-09-20 10:58:55 +00:00

metadata.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

worker.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00