aoshen02 8c79ad6580 Revert "[Core] Replace routing replay with device cache and async D2H pipeline" (#39917) (#42434) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>

2026-05-13 23:49:01 -07:00

..

chat_completion

Revert "[Core] Replace routing replay with device cache and async D2H pipeline" (#39917) (#42434)

2026-05-13 23:49:01 -07:00

completion

Revert "[Core] Replace routing replay with device cache and async D2H pipeline" (#39917) (#42434)

2026-05-13 23:49:01 -07:00

engine

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

generate

[Frontend]Responses API supports chat_template_kwargs (#42272)

2026-05-11 11:59:39 +00:00

generative_scoring

Generative Scoring (#34539)

2026-03-31 16:02:11 -07:00

models

[Frontend][4/n] Improve pooling entrypoints | pooling. (#39153)

2026-04-09 10:09:45 +00:00

parser

[Bugfix] Handle real-world gpt-oss tool call output in Harmony parsing (#42454)

2026-05-13 17:54:46 +00:00

responses

[Bugfix] Handle real-world gpt-oss tool call output in Harmony parsing (#42454)

2026-05-13 17:54:46 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

cli_args.py

Add system_fingerprint field to OpenAI-compatible API responses (#40537)

2026-04-27 16:17:52 +08:00

fingerprint.py

Add system_fingerprint field to OpenAI-compatible API responses (#40537)

2026-04-27 16:17:52 +08:00

orca_metrics.py

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

run_batch.py

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

server_utils.py

[BugFix] KeyError on scope["method"] for realtime api websocket in AuthenticationMiddleware (#36934)

2026-04-15 16:15:01 +00:00

utils.py

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00