Ekagra Ranjanandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> e0b9fb1290 [ASR] Optimize CPU preproc to get 2.5x RTFx via multi-threading (#44612) ...

Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-06-11 21:05:11 -07:00

..

anthropic

[Bugfix] Fix Anthropic tool_use content handling dropping args (#45287)

2026-06-11 20:01:29 +00:00

cli

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

generate

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Bugfix] Fix --enable-prompt-tokens-details omitting zero cached tokens (#44383)

2026-06-11 20:37:42 -07:00

pooling

Deprecations for v0.23 and v0.24 (#44992)

2026-06-11 14:35:38 +00:00

serve

[ASR] Optimize CPU preproc to get 2.5x RTFx via multi-threading (#44612)

2026-06-11 21:05:11 -07:00

speech_to_text

[ASR] Optimize CPU preproc to get 2.5x RTFx via multi-threading (#44612)

2026-06-11 21:05:11 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

chat_utils.py

[CI] Stabilize the multi-audio OpenAI server path (#44051)

2026-06-07 15:54:32 +08:00

grpc_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

launcher.py

[Logs Refactor] Optimize shutdown logs, easier to follow and consistent (#43707)

2026-06-04 14:36:32 -04:00

llm.py

Fix LLM.wait_for_completion output type docstring (#44617)

2026-06-05 00:16:38 -07:00

offline_utils.py

[Frontend] Split the offline inference APIs and utils. (#43553)

2026-05-26 05:20:24 +00:00