Juan Pérez de Algaba and Cyrus Leung
fcae5c9887
[Security] Restrict default CORS origins ( #61009 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-10-11 08:26:02 +00:00
fa312090cb
[Frontend] Accept each connection on the least loaded API worker ( #60723 )
...
Signed-off-by: hao-aaron <aaronhao@inferact.ai >
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 04:40:13 +00:00
Harry Mellor and Claude Opus 5.5
21d9758459
Remove Python 3.10 support now that it is EOL ( #60402 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 02:30:52 -07:00
f226af0e11
[Bugfix] Eliminate frontend ZMQ port TOCTOU with inherited listeners ( #54113 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 06:25:27 +00:00
bnkaiteam and Flora Feng
3722645539
[Bugfix][Frontend] Accept successful 2xx responses for batch output uploads ( #60507 )
...
Signed-off-by: bnkaiteam <bnkaiteam@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-08 02:32:35 +00:00
09e0ce3d82
[Bugfix][Frontend] Apply model-default reasoning parser in GPU-less render server ( #54835 )
...
Signed-off-by: Shimi Bandiel <shimib@google.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-10-06 18:46:24 +08:00
sungbin1015 and Claude
1e5d0ea888
[CI/Build] Fix incorrect CLI arg validation tests in test_cli_args.py ( #46779 )
...
Signed-off-by: sungbin1015 <sbin@solbox.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-10-06 05:58:47 +00:00
Nils Matteson
28556f8600
[Bugfix] Log CRIU failure details before snapshot cleanup ( #59661 )
...
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com >
2026-10-03 04:02:27 +00:00
Nils Matteson
9fdb174678
[Bugfix] Avoid InfiniBand state in TP1 snapshots ( #59699 )
...
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com >
2026-10-03 03:59:17 +00:00
9d2a6f52b2
[Rust Frontend] Expose gRPC port in Python vllm serve ( #59659 )
...
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Signed-off-by: Alec Flowers <aflowers@nvidia.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-10-02 08:14:37 +00:00
Mark McLoughlin and OpenAI Codex
91fcec1235
[Core][Logging] Add built-in JSON formatter ( #58739 )
...
Add `--logging-config.formatter=json` to enable the python-json-logger
formatter without having to use a complete Python logging dictConfig.
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-10-01 09:11:46 +01:00
jackLei
21c08ac458
[CI] Deflake shutdown wait-timeout test by synchronizing on request admission ( #58125 )
...
Signed-off-by: jackLei0901 <42642542+jackLei0901@users.noreply.github.com >
2026-10-01 00:10:03 +00:00
Harry Mellor and Claude Opus 5.5
fc2c801ad9
Disable mypy arg-type and assignment checks in tests ( #59428 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 15:18:50 +00:00
Wentao Ye and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
834ad456d3
[Refactor] Remove dead tests code ( #58916 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-30 04:39:03 +00:00
5dd693122c
[MyPy][2/N] Fix mypy errors in small tests/ dirs ( #51043 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-29 21:27:45 +01:00
Louie Tsai
208bb38c80
[Bugfix][Rust Frontend] Fix startup with config-only model ( #58643 )
...
Signed-off-by: louie-tsai <louie.tsai@intel.com >
2026-09-29 10:11:53 +00:00
Mark McLoughlin and AI Assistant
45d56c0baf
[Core] Model console logging as CLI configuration ( #57205 )
...
Add `--logging-config` CLI argument which can be supplied as
JSON or using dotted arguments. The `--log-level` argument
is provided for convenience, and `--log-config-file` is deprecated
in favor of `--logging-config.pylogging_config_file`.
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
Co-authored-by: AI Assistant <noreply@openai.com >
2026-09-25 11:36:59 +01:00
13058faa49
[Frontend] Add reusable TP1 initialized-engine snapshots ( #51360 )
...
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com >
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
Co-authored-by: elehayym <52448798+Yuzu23@users.noreply.github.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-21 23:18:49 +00:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
Chauncey
f0fbc98c48
[Frontend] Share max_num_queued_reqs across API server processes ( #54746 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-09-15 14:50:26 +00:00
wang.yuqi
67111973ee
[Frontend] Move grpc_server to launchers. ( #56746 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-09-14 05:03:08 +00:00
Francisco Javier Arceo and OpenAI Codex
6a2a2bb02b
[Frontend] Add stateless /v1/responses/render endpoint ( #50195 )
...
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-09-07 12:50:42 +00:00
Adababy and shaolila
2902ca17e3
[Bugfix] complete VLLMValidationError migration in chat_utils.py ( #50254 )
...
Signed-off-by: shaolila <shaolila@buaa.edu.cn >
Co-authored-by: shaolila <shaolila@buaa.edu.cn >
2026-09-05 17:56:12 +08:00
wang.yuqi and Cyrus Leung
eeb549a74d
[Frontend] Move engine/protocol.py out openai folder ( #54492 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: wang.yuqi <noooop@126.com >
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
2026-08-31 10:13:50 +00:00
Moe Huzaifa
3e833933dc
[Bugfix][Frontend] Keep credentials out of the Rust frontend launch log ( #53738 )
...
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com >
2026-08-25 16:32:12 +00:00
wang.yuqi
735daf8ef6
[Frontend] Move cli_args.py and dp_supervisor.py out openai folder ( #53659 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-08-25 07:02:32 +00:00
wang.yuqi
9cef631f30
[Frontend] Move run_batch.py out openai folder ( #53500 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-08-24 15:04:10 +00:00
Andreas Karatzas and OpenAI Codex
cb58bb9c1e
[CI] Harden RemoteVLLMServer GPU cleanup checks ( #52282 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-19 14:17:17 -05:00
wang.yuqi
eac636a7fa
[Frontend] Move api_server.py out openai folder ( #52131 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-08-19 09:43:46 +00:00
