4 people e37e51dd24 [Metrics] Expose cached prompt tokens by cache tier (#56318) ...

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
Signed-off-by: Cam Quilici <cameron@semianalysis.com>
Co-authored-by: Cam Quilici <cameron@semianalysis.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>

2026-10-06 14:52:05 -04:00

..

bench

[vllm-bench, feature] Added support for Mooncake-style, timed-traces replay. (#55937)

2026-10-06 20:39:35 +08:00

build-info

[Build] Propagate vLLM version to Rust binaries (#52593)

2026-08-17 23:37:37 -07:00

chat

[Rust Frontend] Pass tool defer_loading through to chat templates (#60203)

2026-10-06 18:00:15 +08:00

cmd

[Rust Frontend] Expose gRPC port in Python vllm serve (#59659)

2026-10-02 08:14:37 +00:00

engine-core-client

[Metrics] Expose cached prompt tokens by cache tier (#56318)

2026-10-06 14:52:05 -04:00

llm

[Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats (#59205)

2026-09-29 11:01:54 -07:00

managed-engine

[Rust Frontend] Support HF config overrides --hf-overrides (#56931)

2026-09-16 02:52:55 +00:00

metrics

[Metrics] Expose cached prompt tokens by cache tier (#56318)

2026-10-06 14:52:05 -04:00

mock-engine

[Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats (#59205)

2026-09-29 11:01:54 -07:00

parser

[Rust Frontend] Pass tool defer_loading through to chat templates (#60203)

2026-10-06 18:00:15 +08:00

server

[Frontend] Integer token IDs for generate output logprobs (GenerateLogProbs) (#58181)

2026-10-06 17:22:47 +00:00

text

[Feature] Per-row candidate IDs for prefill token scoring (M2 of #56860) (#56984)

2026-10-03 14:17:09 +00:00

tokenizer

[Rust Frontend] Anchor tokens after pending UTF-8 bytes at their own first byte (#58357)

2026-10-01 04:21:50 +00:00

tracing

[Bugfix][Rust Frontend] Prevent MM timing from enabling debug tracing (#58378)

2026-09-24 09:22:23 +00:00