Boyuan FengandHarry Mellor 94e6b2d55f Allow users to specify kv cache memory size (#21489) ...

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-09-11 13:41:07 +00:00

..

cli

[Docs] Add comprehensive CLI reference for all large vllm subcommands (#22601)

2025-08-11 00:13:33 -07:00

openai

[Doc]: fixing doc typos (#24635)

2025-09-10 23:19:28 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Make TIMEOUT_KEEP_ALIVE configurable through env var (#18472)

2025-06-09 21:41:21 +00:00

chat_utils.py

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449)

2025-09-08 06:42:20 -07:00

constants.py

Limit HTTP header count and size (#23267)

2025-08-20 17:57:37 +00:00

context.py

[gpt-oss] Harmony changes with container tool support (#23386)

2025-09-08 19:03:50 -07:00

harmony_utils.py

[gpt-oss] Harmony changes with container tool support (#23386)

2025-09-08 19:03:50 -07:00

launcher.py

[Misc] update log level debug to warning when process port is used by (#24226)

2025-09-10 11:32:57 -07:00

llm.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

logger.py

feat: Add --enable-log-outputs flag for logging model generations (#20707)

2025-08-06 23:10:13 -07:00

renderer.py

Consolidate rendering parameters into RenderConfig dataclass (#24543)

2025-09-10 08:44:47 +00:00

score_utils.py

Support token_type_ids in V1 with less code changes (#21985)

2025-08-10 22:54:59 -07:00

ssl.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tool_server.py

[gpt-oss] Validate gpt-oss python tool during initialization (#23856)

2025-09-09 08:37:48 +00:00

tool.py

[gpt-oss] Validate gpt-oss python tool during initialization (#23856)

2025-09-09 08:37:48 +00:00

utils.py

[Bugfix] when set offline model running error (#23711)

2025-08-28 07:27:45 +00:00