Nicolò Lucchesi dafbef15a1 [Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445) ...

Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>

2026-08-31 14:26:49 +00:00

..

anthropic

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

cli

[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)

2026-08-25 07:02:32 +00:00

cohere

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

generate

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

launchers

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

mcp

[Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext (#45431)

2026-06-12 16:15:41 -04:00

openai

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

pooling

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

scale_out

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

serve

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

speech_to_text

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

chat_utils.py

[Frontend][Performance] Resolve async media across modalities concurrently (#54537)

2026-08-31 10:50:17 +00:00

grpc_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

llm.py

[Feature] Mask Replay (#49577)

2026-08-13 08:44:31 +00:00

offline_utils.py

[Misc] Use VLLMValidationError in offline inference input validation (#53432)

2026-08-23 08:43:51 -07:00