Nicolò Lucchesi dafbef15a1 [Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445) ...

Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>

2026-08-31 14:26:49 +00:00

..

__init__.py

[Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260)

2026-01-14 07:26:24 +00:00

api_router.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

context.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

harmony.py

[Refactor][GPT-OSS] Harmony Responses API Refactor to use HarmonyParser (#47185)

2026-06-30 19:23:20 -04:00

protocol.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

serving.py

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

streaming_events.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

utils.py

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00