 GuanLuoandsfeng33
|
6d1daa9fe5
|
[Bugfix][Frontend] Expose completion response schemas in OpenAPI (#60926)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-10-13 18:54:06 +00:00 |
|
|
Thuongvu HoandNicolò Lucchesi
|
99b44c7a42
|
[Metrics] Add admission rejection metrics (#55812)
Signed-off-by: Thuongvu Ho <thuongvuho@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@mistral.ai>
|
2026-10-12 08:31:07 +00:00 |
|
|
Juan Pérez de AlgabaandCyrus Leung
|
fcae5c9887
|
[Security] Restrict default CORS origins (#61009)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-10-11 08:26:02 +00:00 |
|
|
Suraj Sharanandlinitra24
|
1ee69dde9c
|
[Bugfix][LoRA] Reject PEFT adapter features vLLM does not implement (#60225)
Signed-off-by: suraj <surajsharan85@gmail.com>
Co-authored-by: linitra24 <renshuang.zhou@daocloud.io>
|
2026-10-09 16:39:58 +04:00 |
|
|
|
42ecc8eebe
|
[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 08:29:09 +00:00 |
|
|
SrirajandFlora Feng
|
db6e3cd8c4
|
[Bugfix][Frontend] Log the full request body when max_log_len is unset (#60310)
Signed-off-by: sricursion <sricursion@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-10-07 00:42:17 +00:00 |
|
|
czhu-cohereandaoshen02
|
6fddc9b21e
|
[Profiler] Add per-session profiling controls to Python and Rust frontends (#57875)
Signed-off-by: czhu <conway.zhu@cohere.com>
Signed-off-by: Conway Zhu <conway.zhu@cohere.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-10-06 05:21:19 +00:00 |
|
|
Aarushi JainandAndreas Karatzas
|
bdd31c31de
|
[CI] Stop requiring both API servers to record weight sync metrics (#59521)
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-04 14:14:27 +00:00 |
|
|
|
4caa060053
|
[TEST][CI] Fix serve rlhf tests subprocess import errors (#59622)
Signed-off-by: microslaw <you@example.com>
Co-authored-by: microslaw <you@example.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-10-02 09:47:47 +08:00 |
|
|
Kevin H. LuuandClaude Opus 5.5
|
8bc31bd210
|
[CI] Deflake the multi-API-server metrics test and Mooncake PD ports (#59507)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 17:22:58 -07:00 |
|
|
Harry MellorandClaude Opus 5.5
|
fc2c801ad9
|
Disable mypy arg-type and assignment checks in tests (#59428)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 15:18:50 +00:00 |
|
|
Chaojun ZhangandKunshang Ji
|
02a3c6dfc5
|
[Test] Skip IPC weight-transfer test on XPU platforms (#59379)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-09-30 21:50:40 +08:00 |
|
|
aoshen02andClaude Opus 5.5
|
749192ff41
|
[CI] Skip the IPC weight-checker test on non-CUDA platforms (#59398)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 09:20:32 +00:00 |
|
|
|
713ec07655
|
[Frontend][RL] Track HTTP weight operation outcomes and concurrency (#55781)
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-30 09:19:43 +00:00 |
|
|
|
e5f3d08d72
|
[Frontend][RL] Align sleep-mode API responses and operation metrics (#52864)
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 23:16:38 -07:00 |
|
|
|
42d9f8ccdb
|
support rl feature : weight checker (#51350)
Signed-off-by: shiyuan680 <yangcheng104@huawei.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: shiyuan680 <yangcheng104@huawei.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: DeepSeek Harness <noreply@deepseek.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-30 03:13:43 +00:00 |
|
|
Kevin H. LuuandCodex
|
bec710fccf
|
[CI] Fix mock type narrowing in LoRA serving test (#59344)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-29 19:55:04 -07:00 |
|
|
Nick HillandClaude Opus 5.5
|
105a4e097b
|
[Bugfix][Frontend] Reject LoRA adapters named after a served model (#59286)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 18:29:38 -07:00 |
|
|
|
5dd693122c
|
[MyPy][2/N] Fix mypy errors in small tests/ dirs (#51043)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 21:27:45 +01:00 |
|
|
Cyrus Leung
|
379e9a1ea8
|
[Security] Harden message sanitization (#58832)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-26 16:28:32 +00:00 |
|
|
Wentao Ye
|
bf93e1f92c
|
[Refactor] Remove dead tests utils (#58803)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-09-26 09:16:53 -04:00 |
|
|
Cyrus Leung
|
c8824a1e42
|
[MM] Move supports_multimodal_inputs and cache out of registry (#57913)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-21 07:43:07 -07:00 |
|
|
|
092bdd6d57
|
[Frontend][Core] Add release_kv_cache_memory() API (#44890)
Signed-off-by: Dakai An <dakaian108@gmail.com>
Signed-off-by: AlanFokCo <alanfok2868@gmail.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Dakai An <77474977+andakai@users.noreply.github.com>
Co-authored-by: AlanFokCo <alanfok2868@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-18 07:12:12 +08:00 |
|
|
Harry MellorandClaude Opus 5
|
651a88c09a
|
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 10:57:24 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
linitra24andJee Jee Li
|
c81eb3e69c
|
[LoRA] Support modules_to_save for sequence classification (#53555)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Signed-off-by: linitra24 <renshuang.zhou@daocloud.io>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-09-16 07:15:42 -07:00 |
|
|
wang.yuqi
|
fe4d4109c2
|
[Frontend][last/N] Move all non-OpenAI content out of the OpenAI folder. (#56369)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-11 05:33:26 +00:00 |
|
|
|
ea40bb9e90
|
[feature] Watermarked generation and detection (Gumbel-max algorithm) (#54053)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 21:00:15 -07:00 |
|
|
lzhan011
|
fa99a6fea6
|
[Bugfix][Security] Bound the validation-error response body (#54684)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
|
2026-09-01 06:51:16 +00:00 |
|
|
Amy (Yu-Hsuan) Lin
|
923949e6e3
|
[Feat] Add request-level preemption count histogram metric (#49984)
|
2026-08-31 23:04:54 -04:00 |
|
|
wang.yuqiandCyrus Leung
|
eeb549a74d
|
[Frontend] Move engine/protocol.py out openai folder (#54492)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-31 10:13:50 +00:00 |
|
|
stefankoncarevic
|
5f213ed159
|
[ROCm][CI] Warm up the RLHF dev server before the pause/resume timing checks (#53594)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-08-28 09:07:04 +00:00 |
|
|
Moe Huzaifa
|
3e833933dc
|
[Bugfix][Frontend] Keep credentials out of the Rust frontend launch log (#53738)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 16:32:12 +00:00 |
|
|
Moe Huzaifa
|
d3e2888c75
|
[Bugfix][Frontend] Redact hf_token in the non-default args log (#53625)
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com>
|
2026-08-25 03:06:46 +00:00 |
|
|
wang.yuqi
|
9cef631f30
|
[Frontend] Move run_batch.py out openai folder (#53500)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-24 15:04:10 +00:00 |
|
|
wang.yuqi
|
eac636a7fa
|
[Frontend] Move api_server.py out openai folder (#52131)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-19 09:43:46 +00:00 |
|
|
LuckyStep
|
9a9aa2b017
|
[Bugfix] Redact api_key in non-default args log (#52523)
Signed-off-by: LuckyStep <67696304+Andy365-365@users.noreply.github.com>
|
2026-08-19 15:52:53 +08:00 |
|
|
Rajath Pai
|
b01728b088
|
[Bugfix] Return 4xx for client-caused errors in /detokenize (#52622)
Signed-off-by: rajathpi <rajathpai2000@gmail.com>
|
2026-08-18 07:07:15 +00:00 |
|
|
flb_
|
d785eb51ce
|
[Test] Add pause/resume E2E tests (#52144)
Signed-off-by: flb_ <floatlibai@gmail.com>
|
2026-08-18 14:46:44 +08:00 |
|
|
|
c89d692cb5
|
[Build] Propagate vLLM version to Rust binaries (#52593)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 23:37:37 -07:00 |
|
|
wang.yuqi
|
93550cc4cd
|
[Frontend] Consolidate entrypoint middleware (#52309)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-17 06:17:15 +00:00 |
|
|
Do_it_now_!
|
70aaec832b
|
[Bugfix][Anthropic] Return 4xx for client-caused errors in /v1/messages (#52246)
Signed-off-by: Do_it_now_! <lizhengcheng233@gmail.com>
|
2026-08-16 01:05:17 -07:00 |
|
|
wang.yuqi
|
b8165e5e58
|
[Frontend] Consolidate entrypoint exception handler (#52261)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-14 09:27:24 +00:00 |
|
|
yang rui
|
152c913a63
|
[Frontend] Log output token IDs at DEBUG level (#52098)
Signed-off-by: ruirui6946 <142162413+ruirui6946@users.noreply.github.com>
|
2026-08-13 13:11:51 +00:00 |
|
|
Zach Zhu
|
58f9659397
|
[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)
Signed-off-by: Zach Zhu <zzqshu@126.com>
|
2026-07-29 04:20:40 +00:00 |
|
|
Harry MellorandAndreas Karatzas
|
ca0defa343
|
Make bare hugging_face imports forbidden (#49726)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-25 04:18:39 -07:00 |
|
|
wang.yuqi
|
61c9ef986a
|
[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-22 10:56:23 +00:00 |
|
|
Muhammad FawazandMahad Durrani
|
e87521626f
|
Sanitize server file paths from validation error responses (#46415)
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com>
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com>
|
2026-07-09 17:46:29 +08:00 |
|
|
Zach Zhu
|
5d5fab0061
|
[Bugfix][Frontend] Fix http_requests_total metric recording some 4xx errors as 5xx (#44303)
Signed-off-by: Zach Zhu <zzqshu@126.com>
|
2026-07-08 05:33:21 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
e55cc59e52
|
[Rust Frontend][CI] Unblock more end-to-end test cases (#47735)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-07 08:27:20 +00:00 |
|