 Cyrus Leung
|
56cac80b14
|
[Deprecation] Remove assistant_token_mask support (#57520)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-19 00:17:51 +08:00 |
|
|
|
dee37d8911
|
[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-18 04:32:39 +00:00 |
|
|
xinnywinneandBenjamin Chislett
|
fbf2c5e8be
|
[Frontend] Add per-request metrics to Responses API (#55084)
Signed-off-by: wxin <wxin@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-09-16 22:52:05 +00:00 |
|
|
yzong-rhandFlora Feng
|
5a6ccc5892
|
[Bugfix] Add Responses cache_write_tokens for API compat and CC parity (#57222)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-16 21:52:34 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
651a88c09a
|
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 10:57:24 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
shaohuaxiandCodex
|
e0301afb2a
|
[Bugfix][Responses] Clean up MCP tool sessions once before closing them (#56988)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 14:07:06 +08:00 |
|
|
Alexander LeeandOpenAI Codex
|
10e8d5614c
|
[Bugfix][Beam Search] Respect skip_special_tokens during decoding (#56211)
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-09-14 05:49:44 +00:00 |
|
|
Nicole LiHui 🥜andChauncey
|
7ef4d9bfed
|
[Bugfix][Responses] Fix browser.find action type (#55305)
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-11 12:07:04 +00:00 |
|
|
wang.yuqi
|
fe4d4109c2
|
[Frontend][last/N] Move all non-OpenAI content out of the OpenAI folder. (#56369)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-11 05:33:26 +00:00 |
|
|
|
ea40bb9e90
|
[feature] Watermarked generation and detection (Gumbel-max algorithm) (#54053)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 21:00:15 -07:00 |
|
|
Nikhil KulkarniandClaude Fable 5.1
|
114abd1c11
|
[Bugfix][Frontend] Reject unsupported Responses API input items with 400 instead of 500 (#55974)
Signed-off-by: Nikhil Kulkarni <nikhilkulkarni1755@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-09 07:51:45 +00:00 |
|
|
Adababyandshaolila
|
167858ea17
|
[Frontend] Migrate Responses harmony input validation to VLLMValidationError (#55701)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-07 13:30:11 +00:00 |
|
|
Francisco Javier ArceoandOpenAI Codex
|
6a2a2bb02b
|
[Frontend] Add stateless /v1/responses/render endpoint (#50195)
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-07 12:50:42 +00:00 |
|
|
Adababyandshaolila
|
7dbe386833
|
[Frontend] Migrate Responses API validation errors to VLLMValidationError (#50257)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-07 17:33:51 +08:00 |
|
|
|
e962733e08
|
[Security] Validate cache salts before they reach LMCache (#51444)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-05 03:56:06 +00:00 |
|
|
Nicolò Lucchesi
|
dafbef15a1
|
[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-31 14:26:49 +00:00 |
|
|
wang.yuqiandCyrus Leung
|
eeb549a74d
|
[Frontend] Move engine/protocol.py out openai folder (#54492)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-31 10:13:50 +00:00 |
|
|
Juan Pérez de Algaba
|
1dc464d426
|
[Bugfix] Bound cache_salt length to prevent DoS via scheduler CPU exhaustion (#54353)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-30 04:28:16 +00:00 |
|
|
Kaif KohariandCyrus Leung
|
7fbfca2670
|
[Bugfix][Frontend] Only echo the assistant turn in batched chat completions (#52529)
Signed-off-by: Kaif <kaifkohari10@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-29 09:44:17 -07:00 |
|
|
Taneem Ibrahim
|
d7b6a35967
|
[Bugfix] Handle malformed namespace tools (#53763)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-27 14:18:16 -04:00 |
|
|
Ting SUN
|
50708f95ae
|
[Bugfix][OpenAI] Fix streamed completion logprob offsets with echo (#47815)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-08-27 18:19:07 +08:00 |
|
|
wang.yuqi
|
735daf8ef6
|
[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-25 07:02:32 +00:00 |
|
|
wang.yuqi
|
9cef631f30
|
[Frontend] Move run_batch.py out openai folder (#53500)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-24 15:04:10 +00:00 |
|
|
Tan ChaoandClaude
|
e239947777
|
[Bugfix][Frontend] Fix run_batch upload retrying on success and unawaited error body (#50588)
Signed-off-by: Chao Tan <chaos.tc@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-24 11:33:44 +00:00 |
|
|
Clinton ThomasandLucas Bourtoule
|
2ec6f0d71e
|
Reject oversized media before fully downloading it (#51896)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
|
2026-08-24 01:15:09 +00:00 |
|
|
Dieter Schwarzmann
|
585bb07c70
|
feat: add SSE keep-alive comments for idle streaming responses (#51034)
Signed-off-by: fuzzifikation <40043768+fuzzifikation@users.noreply.github.com>
|
2026-08-23 18:13:02 -07:00 |
|
|
andrewbcohere
|
f94dcde5c5
|
Fix Cohere ChatV2 citation and tool handling issues (#52175)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
|
2026-08-21 15:23:17 -07:00 |
|
|
Tan Chao
|
1baf372bfc
|
[Frontend] Use VLLMValidationError for batch request URL validation (#50191)
Signed-off-by: Chao Tan <chaos.tc@gmail.com>
|
2026-08-21 09:07:24 -07:00 |
|
|
Greg Pereira
|
18aa245a99
|
using existing uvicorn configuration for dp supervisor (#52473)
Signed-off-by: Gregory Pereira <grpereir@redhat.com>
|
2026-08-21 09:06:54 -07:00 |
|
|
|
7cfb97e337
|
[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)
Signed-off-by: Matthew Kotila <7692737+matthewkotila@users.noreply.github.com>
Co-authored-by: Reed Meyerson <31574681+reed-meyerson@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-20 15:42:49 -07:00 |
|
|
|
3a386cfaf5
|
[ROCm] Give EngineCore cleanup grace after request abort (#52281)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-19 11:39:59 -05:00 |
|
|
wang.yuqi
|
eac636a7fa
|
[Frontend] Move api_server.py out openai folder (#52131)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-19 09:43:46 +00:00 |
|
|
Vineeth Sai Varikuntla
|
86a89a9348
|
[Bugfix][Frontend] Run the serve arg checks for vllm launch too (#52825)
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com>
|
2026-08-19 04:48:50 +00:00 |
|
|
Yufeng He
|
5c9ff5366b
|
[Bugfix] Accept logprobs=-1 in the Completion API (#46175)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
|
2026-08-18 08:22:13 +00:00 |
|
|
wang.yuqi
|
93550cc4cd
|
[Frontend] Consolidate entrypoint middleware (#52309)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-17 06:17:15 +00:00 |
|
|
Kaif Kohari
|
a6a2a93f9b
|
[Bugfix][Frontend] Guard remaining before-validators against non-object JSON bodies (#52528)
Signed-off-by: Kaif <kaifkohari10@gmail.com>
|
2026-08-17 02:27:59 +00:00 |
|
|
Jeffrey WangandClaude Opus 5
|
41f12a0daf
|
[Bugfix] Raise VLLMValidationError from structured output validators (#52394)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-16 01:04:51 -07:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ac2ae8798c
|
[Frontend] Support count_reasoning_tokens in the Streaming Parser Engine (#45802)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-15 06:51:14 -07:00 |
|
|
wang.yuqi
|
b8165e5e58
|
[Frontend] Consolidate entrypoint exception handler (#52261)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-14 09:27:24 +00:00 |
|
|
|
7553aac77b
|
[Frontend] Add routed-experts prompt offset (#51906)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-13 08:09:00 -07:00 |
|
|
yang rui
|
152c913a63
|
[Frontend] Log output token IDs at DEBUG level (#52098)
Signed-off-by: ruirui6946 <142162413+ruirui6946@users.noreply.github.com>
|
2026-08-13 13:11:51 +00:00 |
|
|
Russell BryantandClaude Opus 4.8
|
8151f2ad43
|
[Docs] Warn that --api-key does not gate all endpoints (#51999)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-12 08:16:35 -07:00 |
|
|
|
b64a2708b0
|
Bound generation inputs before expensive work (#51447)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 22:03:50 +08:00 |
|
|
Tarun Kumar
|
48bada6ea4
|
Fix chat completion 500 on non-object JSON bodies (#51654)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
|
2026-08-11 01:31:19 +00:00 |
|
|
Nick Hill
|
ac70ce96e0
|
[Frontend] Disable uvicorn signal handlers instead of racing them (#50916)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-07 13:40:24 -06:00 |
|
|
Chauncey
|
22170354d8
|
[Feature] Parse request priority from HTTP header (#51089)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-08-05 21:10:29 -07:00 |
|
|
Karen Chung
|
f57123aa2d
|
feat(frontend): session id plumbing into requests (#48048)
Signed-off-by: Karen Chung <karenc@nvidia.com>
|
2026-08-03 22:18:58 +00:00 |
|
|
Cyrus Leung
|
b3f97dae24
|
[Frontend] Require cache_salt to be non-empty via schema (#50816)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-03 06:51:27 +00:00 |
|
|
yzong-rh
|
dc818c198d
|
[GPT-OSS] Strict tool call and constrained decoding for Harmony (#45560)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-01 12:10:26 -04:00 |
|