Benjamin Chislett 455f25aa13 [CLI] Add flag to print TTFT and TPS in vllm chat (#46775) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

2026-06-26 22:15:10 -07:00

..

anthropic

[Bugfix][Frontend] Emit a content block for empty Anthropic completions (#46525)

2026-06-24 00:04:26 +00:00

cli

[CLI] Add flag to print TTFT and TPS in vllm chat (#46775)

2026-06-26 22:15:10 -07:00

generate

[Perf] Skip detokenization in online beam search (#46422)

2026-06-23 15:46:09 -07:00

mcp

[Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext (#45431)

2026-06-12 16:15:41 -04:00

openai

[Bugfix][Parser] Pass token IDs to parser.parse() in Responses API and batch serving (#46843)

2026-06-26 19:29:52 +00:00

pooling

[Pooling] Fix Cohere embed billed image token accounting for mixed-content inputs (#46093)

2026-06-25 10:44:29 -04:00

serve

[API] Add token offsets to render endpoints (/v1/.../render) (#44226)

2026-06-26 05:02:52 -07:00

speech_to_text

[Frontend] Refactor ServingTokenization entrypoint. (#46022)

2026-06-22 06:27:58 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

chat_utils.py

[CI] Stabilize the multi-audio OpenAI server path (#44051)

2026-06-07 15:54:32 +08:00

grpc_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

launcher.py

[Logs Refactor] Optimize shutdown logs, easier to follow and consistent (#43707)

2026-06-04 14:36:32 -04:00

llm.py

Revert "Fix Stale Encoder Cache After Weight Update" (#46125)

2026-06-20 07:09:09 -07:00

offline_utils.py

[Frontend] Split the offline inference APIs and utils. (#43553)

2026-05-26 05:20:24 +00:00