Nick HillandBugen Zhao f2ace1d57d [Frontend][RFC] Rust front-end integration (#40848) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>

2026-05-21 12:24:48 +08:00

..

anthropic

[Frontend] Add defer_loading and tool_reference support for Anthropic and OpenAI APIs (#40190)

2026-04-29 04:35:50 -07:00

cli

[Frontend][RFC] Rust front-end integration (#40848)

2026-05-21 12:24:48 +08:00

generate

[Frontend] Consolidate beam search by BeamSearchMixin. (#42946)

2026-05-19 07:37:40 +00:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Frontend][RFC] Rust front-end integration (#40848)

2026-05-21 12:24:48 +08:00

pooling

[Entrypoints] Split the pooling offline API into PoolingOfflineMixin. (#42267)

2026-05-15 08:05:57 +00:00

sagemaker

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675)

2026-04-16 07:53:23 -07:00

serve

[Frontend] Forward X-data-parallel-rank header on /inference/v1/generate (#42330)

2026-05-20 08:58:46 +00:00

speech_to_text

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

[Deprecation] Remove old locations of get_tokenizer and resolve_hf_chat_template (#35024)

2026-05-15 00:13:32 -07:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

grpc_server.py

[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016)

2026-04-22 21:31:00 +00:00

launcher.py

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666)

2026-03-13 12:10:06 -07:00

llm.py

add enqueue all option to throughput benchmark (#42975)

2026-05-19 20:16:02 -07:00

logger.py

[Doc] Improve UX of --enable-log-requests (#35723)

2026-03-02 08:24:09 -08:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[Frontend][RFC] Rust front-end integration (#40848)

2026-05-21 12:24:48 +08:00