Logo
Explore Help
Sign In
iHore/vLLM
Watch 8
Star 0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
eb28e8068dd870283f1a4fe8251ed9254d6f477e
vLLM/vllm/v1/kv_offload
T
History
Or Ozeri 9cddbdba6d OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)
Signed-off-by: Or Ozeri <oro@il.ibm.com>
2026-01-12 15:00:43 +00:00
..
backends
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
worker
[KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870)
2026-01-11 08:05:36 +00:00
__init__.py
[Docs] Enable fail_on_warning for the docs build in CI (#25580)
2025-09-24 19:30:33 +00:00
abstract.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
arc_manager.py
Implement ARC KV cache eviction policy for CPU offloader (#27039)
2025-11-12 09:51:39 -08:00
backend.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
cpu.py
OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)
2026-01-12 15:00:43 +00:00
factory.py
OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)
2026-01-12 15:00:43 +00:00
lru_manager.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
mediums.py
[KV offload][1b/N] rename offloading to kv_offload (#25191)
2025-09-18 20:53:52 +00:00
spec.py
OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)
2026-01-12 15:00:43 +00:00
Powered by Gitea Version: 1.27.2 Page: 514ms Template: 8ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API