Boyuan FengandHarry Mellor 94e6b2d55f Allow users to specify kv cache memory size (#21489) ...

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-09-11 13:41:07 +00:00

..

multiprocessing

[Doc]: fix typos in Python comments (#24417)

2025-09-08 00:22:16 -07:00

output_processor

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

async_llm_engine.py

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

async_timeout.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

llm_engine.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

metrics_types.py

[Metrics] Deprecate TPOT in favor of ITL (#24110)

2025-09-02 18:10:10 +00:00

metrics.py

[Metrics] Deprecate TPOT in favor of ITL (#24110)

2025-09-02 18:10:10 +00:00

protocol.py

[Engine][Chore] use local variable and remove output var assignment (#24554)

2025-09-10 23:05:42 -07:00