wang.yuqi d01d0b4646 [Frontend] Consolidate online serving utils. (#44479) ...

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

2026-06-04 06:49:31 +00:00

..

anthropic

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

cli

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

generate

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

pooling

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

serve

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

speech_to_text

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

chat_utils.py

[Bugfix] fix crash in postprocess for null tool args (#43862)

2026-06-02 22:17:26 -07:00

grpc_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

launcher.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

llm.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

offline_utils.py

[Frontend] Split the offline inference APIs and utils. (#43553)

2026-05-26 05:20:24 +00:00