3 people 10e6a7f210 [Frontend] Expose per-request spec decode metrics in generate API (#43310) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <codex@openai.com>

2026-09-20 12:21:33 +00:00

..

bench

[Bugfix][Rust] Fix HF multi-turn dataset integration (#56915)

2026-09-14 18:04:46 -07:00

build-info

[Build] Propagate vLLM version to Rust binaries (#52593)

2026-08-17 23:37:37 -07:00

chat

[Rust Frontend] Return sampling masks over gRPC (#56777)

2026-09-18 08:26:17 +00:00

cmd

[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)

2026-09-18 04:32:39 +00:00

engine-core-client

[Frontend] Expose per-request spec decode metrics in generate API (#43310)

2026-09-20 12:21:33 +00:00

llm

[Frontend] Expose per-request spec decode metrics in generate API (#43310)

2026-09-20 12:21:33 +00:00

managed-engine

[Rust Frontend] Support HF config overrides --hf-overrides (#56931)

2026-09-16 02:52:55 +00:00

metrics

[Rust Frontend][Metrics] Add per-request preemption histogram (#57033)

2026-09-16 02:51:17 +00:00

mock-engine

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

parser

[Frontend] Upgrade XGrammar to 0.2.7 and Rust structural tags to 0.3.0 (#57272)

2026-09-18 11:44:05 +00:00

server

[Frontend] Expose per-request spec decode metrics in generate API (#43310)

2026-09-20 12:21:33 +00:00

text

[Rust Frontend] Return sampling masks over gRPC (#56777)

2026-09-18 08:26:17 +00:00

tokenizer

[Bugfix][Rust Frontend] Skip undefined token ids in decode and anchor them zero-width (#55240)

2026-09-09 09:55:04 +00:00

tracing

[Rust Frontend] Extract shared tracing setup logic into vllm-tracing (#50129)

2026-07-28 19:31:15 +00:00