Aaron HaoandIsotr0py 2d6b3489b9 [R3] Add routed experts to openai entrypoint (#38939) ...

Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2026-05-20 09:07:59 -07:00

..

anthropic

[Frontend] Add defer_loading and tool_reference support for Anthropic and OpenAI APIs (#40190)

2026-04-29 04:35:50 -07:00

cli

[Frontend] Delegate to vLLM Omni When --omni Passed (#40744)

2026-04-24 12:30:00 -04:00

generate

[Frontend] Consolidate beam search by BeamSearchMixin. (#42946)

2026-05-19 07:37:40 +00:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[R3] Add routed experts to openai entrypoint (#38939)

2026-05-20 09:07:59 -07:00

pooling

[Entrypoints] Split the pooling offline API into PoolingOfflineMixin. (#42267)

2026-05-15 08:05:57 +00:00

sagemaker

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675)

2026-04-16 07:53:23 -07:00

serve

[Frontend] Forward X-data-parallel-rank header on /inference/v1/generate (#42330)

2026-05-20 08:58:46 +00:00

speech_to_text

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

[Deprecation] Remove old locations of get_tokenizer and resolve_hf_chat_template (#35024)

2026-05-15 00:13:32 -07:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

grpc_server.py

[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016)

2026-04-22 21:31:00 +00:00

launcher.py

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666)

2026-03-13 12:10:06 -07:00

llm.py

add enqueue all option to throughput benchmark (#42975)

2026-05-19 20:16:02 -07:00

logger.py

[Doc] Improve UX of --enable-log-requests (#35723)

2026-03-02 08:24:09 -08:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

2026-05-06 16:10:17 +00:00