TomerBN-Nvidia 8189a15914 [Core] Replace routing replay with device cache and async D2H pipeline (#39917) ...

Signed-off-by: Tomer Barnatan <tbarnatan@nvidia.com>

2026-05-07 11:24:56 -07:00

..

__init__.py

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00

api_router.py

Add /v1/chat/completions/batch endpoint for batched chat completions (#38011)

2026-03-26 12:13:33 +08:00

batch_serving.py

Add system_fingerprint field to OpenAI-compatible API responses (#40537)

2026-04-27 16:17:52 +08:00

protocol.py

[Core] Replace routing replay with device cache and async D2H pipeline (#39917)

2026-05-07 11:24:56 -07:00

serving.py

[Core] Replace routing replay with device cache and async D2H pipeline (#39917)

2026-05-07 11:24:56 -07:00

stream_harmony.py

[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)

2026-02-25 08:08:16 -08:00