TomerBN-Nvidia 8189a15914 [Core] Replace routing replay with device cache and async D2H pipeline (#39917) ...

Signed-off-by: Tomer Barnatan <tbarnatan@nvidia.com>

2026-05-07 11:24:56 -07:00

..

chat_completion

[Core] Replace routing replay with device cache and async D2H pipeline (#39917)

2026-05-07 11:24:56 -07:00

completion

[Core] Replace routing replay with device cache and async D2H pipeline (#39917)

2026-05-07 11:24:56 -07:00

engine

fix(openai): tolerate empty content in forced tool choice (#40148)

2026-05-06 07:16:03 -07:00

generate

Add system_fingerprint field to OpenAI-compatible API responses (#40537)

2026-04-27 16:17:52 +08:00

generative_scoring

Generative Scoring (#34539)

2026-03-31 16:02:11 -07:00

models

[Frontend][4/n] Improve pooling entrypoints | pooling. (#39153)

2026-04-09 10:09:45 +00:00

parser

[DSV4] Support max reasoning effort (#40982)

2026-04-29 11:03:47 +00:00

realtime

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

responses

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

2026-05-06 16:10:17 +00:00

speech_to_text

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

feat: update xgrammar==0.2.0 to use structural tags for strict tool calling + reasoning for more models (#40894)

2026-05-04 12:45:24 -07:00

cli_args.py

Add system_fingerprint field to OpenAI-compatible API responses (#40537)

2026-04-27 16:17:52 +08:00

fingerprint.py

Add system_fingerprint field to OpenAI-compatible API responses (#40537)

2026-04-27 16:17:52 +08:00

orca_metrics.py

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

run_batch.py

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

2026-03-31 07:52:00 +00:00

server_utils.py

[BugFix] KeyError on scope["method"] for realtime api websocket in AuthenticationMiddleware (#36934)

2026-04-15 16:15:01 +00:00

utils.py

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00