Nicolò Lucchesi dafbef15a1 [Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445) ...

Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>

2026-08-31 14:26:49 +00:00

..

chat_completion

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

completion

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

models

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

parser

[Bugfix] GPT-OSS Autodrop reasoning in Response API and cleanup (#45048)

2026-06-23 09:36:33 -04:00

responses

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

run_batch.py

[Frontend] Move run_batch.py out openai folder (#53500)

2026-08-24 15:04:10 +00:00

sse_keep_alive.py

feat: add SSE keep-alive comments for idle streaming responses (#51034)

2026-08-23 18:13:02 -07:00