halleriteandClaude Opus 4.7 97c4317bf5 [Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329) ...

Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-13 11:16:46 +02:00

..

anthropic

[Frontend] Add defer_loading and tool_reference support for Anthropic and OpenAI APIs (#40190)

2026-04-29 04:35:50 -07:00

cli

[Frontend] Delegate to vLLM Omni When --omni Passed (#40744)

2026-04-24 12:30:00 -04:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Bugfix] [Frontend] Responses API, fix merging of messages (#42189)

2026-05-12 16:09:59 +00:00

pooling

[chore] Refactor pooling metadata token ID accessors (#42368)

2026-05-13 06:08:01 +00:00

sagemaker

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675)

2026-04-16 07:53:23 -07:00

serve

[Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329)

2026-05-13 11:16:46 +02:00

speech_to_text

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

feat: Enable prompt_embeds Content Part Support in vLLM Chat Completions API (#40720)

2026-05-01 10:05:55 +08:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

grpc_server.py

[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016)

2026-04-22 21:31:00 +00:00

launcher.py

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666)

2026-03-13 12:10:06 -07:00

llm.py

[feat] Add explicit /start_weight_update and /finish_weight_update APIs for weight transfer (#39212)

2026-05-08 18:03:33 -07:00

logger.py

[Doc] Improve UX of --enable-log-requests (#35723)

2026-03-02 08:24:09 -08:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

2026-05-06 16:10:17 +00:00