Matthew BonanniandTyler Michael Smith 96a85c5750 [Startup][UX] Enable CUDAGraph memory profiling by default (#38284) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

2026-04-21 18:16:59 -04:00

..

anthropic

[Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125)

2026-04-20 06:10:45 -07:00

cli

Revert "[Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm" (#40438)

2026-04-21 08:47:18 +00:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

Revert "[Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm" (#40438)

2026-04-21 08:47:18 +00:00

pooling

[Frontend] Remove frontend pooling multi task support. (#37861)

2026-04-21 12:27:44 +00:00

sagemaker

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675)

2026-04-16 07:53:23 -07:00

serve

[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405)

2026-04-17 20:31:56 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

[bugfix] Normalize tool message content from array to string format (#39899)

2026-04-16 11:54:39 -07:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

grpc_server.py

[Bugfix] Preserve original ImportError in gRPC server entrypoint (#38673)

2026-04-01 22:16:44 +00:00

launcher.py

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666)

2026-03-13 12:10:06 -07:00

llm.py

[Startup][UX] Enable CUDAGraph memory profiling by default (#38284)

2026-04-21 18:16:59 -04:00

logger.py

[Doc] Improve UX of --enable-log-requests (#35723)

2026-03-02 08:24:09 -08:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616)

2026-03-25 10:55:51 +00:00