3 people 10e6a7f210 [Frontend] Expose per-request spec decode metrics in generate API (#43310) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <codex@openai.com>

2026-09-20 12:21:33 +00:00

..

anthropic

[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)

2026-09-18 04:32:39 +00:00

cli

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

cohere

[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)

2026-09-18 04:32:39 +00:00

generate

[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)

2026-09-18 04:32:39 +00:00

launchers

[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)

2026-09-18 04:32:39 +00:00

mcp

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

openai

[Deprecation] Remove assistant_token_mask support (#57520)

2026-09-19 00:17:51 +08:00

pooling

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

scale_out

[Frontend] Expose per-request spec decode metrics in generate API (#43310)

2026-09-20 12:21:33 +00:00

serve

[Core][Frontend] Bind KV-event publishers at port 0 and expose the bound endpoints (#55844)

2026-09-18 18:11:05 -07:00

speech_to_text

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

chat_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

grpc_server.py

[Frontend] Move grpc_server to launchers. (#56746)

2026-09-14 05:03:08 +00:00

llm.py

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

offline_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00