This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
1806d1adfc9b598bc6eb94de38a330aaad04c291
vLLM
/
vllm
/
v1
/
kv_offload
/
cpu
T
History
Ronen Schaffer
84747489de
Tier offload followup (
#42529
)
...
Signed-off-by: Ronen Schaffer <
ronen.schaffer@ibm.com
>
2026-05-18 19:41:58 +00:00
..
policies
[kv_offload] Implement
reset_cache()
for the offloading connector (
#41956
)
2026-05-14 16:00:10 +03:00
__init__.py
[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into
cpu/
package (
#37874
)
2026-03-24 07:02:51 +02:00
common.py
[Refactor][kv_offload] KV Offloading maintainability improvements (
#40538
)
2026-04-30 05:55:31 +03:00
gpu_worker.py
[kv_offload] Add multi-tier KV cache offloading framework (
#40020
)
2026-05-13 17:21:43 +03:00
manager.py
[kv_offload] Implement
reset_cache()
for the offloading connector (
#41956
)
2026-05-14 16:00:10 +03:00
shared_offload_region.py
[kv_offload] Add multi-tier KV cache offloading framework (
#40020
)
2026-05-13 17:21:43 +03:00
spec.py
Tier offload followup (
#42529
)
2026-05-18 19:41:58 +00:00