This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
78300cdabffbaaffe7625ed34412ec2aec75535c
vLLM
/
vllm
/
v1
/
simple_kv_offload
T
History
mevince
4ae6228284
[Bugfix][KV Connector] Populate SimpleCPUOffload BlockStored metadata (
#54325
)
2026-09-03 15:58:07 +00:00
..
__init__.py
[Feat][v1] Simple yet General CPU KV Cache Offloading (
#37160
)
2026-03-31 17:58:37 -07:00
copy_backend.py
[Bugfix][KVConnector] Fix SimpleCPUOffloadConnector GPU->CPU store race (
#46278
)
2026-06-22 13:08:47 -07:00
cuda_mem_ops.py
[ROCm] Cpu offload for ROCm 7.13+ to align the hipMemcpyBatchAsync params and perf in 7.14x (
#43018
)
2026-08-21 09:07:03 -07:00
disk_backend.py
[Bugfix] Fix cross-batch buffer race corrupting DiskBackend loads (
#51667
)
2026-09-02 08:18:41 +00:00
manager.py
[Bugfix][KV Connector] Populate SimpleCPUOffload BlockStored metadata (
#54325
)
2026-09-03 15:58:07 +00:00
metadata.py
[Feat][v1] Simple yet General CPU KV Cache Offloading (
#37160
)
2026-03-31 17:58:37 -07:00
worker.py
[Core][KV Connector] Start async KV loads after the forward launch when no sync loads are scheduled (
#53333
)
2026-08-28 21:58:00 +00:00