|
c6843d397c
|
[Bugfix][Frontend] Validate reused prompt token ids; render messages for media and echo (#55771)
Signed-off-by: Shijie Lyu <sjlyu@amazon.com>
Co-authored-by: Shijie Lyu <sjlyu@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-29 10:36:22 +08:00 |
|
|
Flora Feng
|
6f65fde419
|
[Bugfix][Frontend] Apply Harmony adjust_request in batched chat completions (#58958)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-28 04:12:04 +00:00 |
|
|
Flora Feng
|
3184226984
|
[Bugfix][Frontend] Count Responses reasoning tokens per tool round (#58927)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-28 00:34:38 +00:00 |
|
|
|
73859fec58
|
[Frontend] Switch Python Harmony dependency to oss-harmony (#55128)
Signed-off-by: Anton Peganov <apeganov@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-28 00:43:56 +04:00 |
|
|
Robert ShawandRobert Shaw
|
dfab504333
|
[Bugfix][Frontend] Detect Anthropic inline-system merge against the resolved chat template (#58754)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
|
2026-09-26 14:00:56 +00:00 |
|
|
Juan Pérez de AlgabaandCursor
|
31f2e70cd3
|
[Security] Gate per-request multimodal processor kwargs (#58830)
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-26 11:10:35 +00:00 |
|
|
|
8b47e8b22c
|
[Perf][Frontend] Defer reasoning usage recounts for non-continuous chat streams (#56067)
Signed-off-by: Cheng Rui <286040359@qq.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-25 14:08:23 -07:00 |
|
|
|
7871963fcc
|
[Bugfix][Frontend] Respect max_output_tokens in the Harmony tool-call loop (#58551)
Signed-off-by: errmakov <ide404@gmail.com>
Co-authored-by: Du Bin <8174807+dubin555@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-25 14:00:39 -07:00 |
|
|
|
f339e0e757
|
[Bugfix][Frontend] Keep logprobs of parser-suppressed streaming chunks (#58583)
Signed-off-by: errmakov <ide404@gmail.com>
Co-authored-by: Yanxiao Zhao <39199723+sdpkjc@users.noreply.github.com>
Co-authored-by: Prakhar Agarwal <270064960+agarwalprakhar2511@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-25 16:33:19 +00:00 |
|
|
|
a7d203efe5
|
fix(config): apply presence_penalty/frequency_penalty from override-generation-config (#50769)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Signed-off-by: hclsys <chenglunhu@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-24 08:48:18 -07:00 |
|
|
|
d95a896ea6
|
[Feature][Frontend] Add DeepSeek-V4 FIM completion rendering (#44229)
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-23 13:02:00 +00:00 |
|
|
Ting SUN
|
b33c8a657d
|
[Bugfix][Frontend] Keep length finish_reason for max_tokens-truncated streaming tool calls (#46303)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-09-23 14:31:10 +08:00 |
|
|
Cyrus Leung
|
c8824a1e42
|
[MM] Move supports_multimodal_inputs and cache out of registry (#57913)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-21 07:43:07 -07:00 |
|
|
|
0b7f11a1ee
|
[AuxOutput] Add block-keyed storage for routed-expert outputs (#45635)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-21 10:25:05 +00:00 |
|
|
xinnywinneandBenjamin Chislett
|
fbf2c5e8be
|
[Frontend] Add per-request metrics to Responses API (#55084)
Signed-off-by: wxin <wxin@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-09-16 22:52:05 +00:00 |
|
|
yzong-rhandFlora Feng
|
5a6ccc5892
|
[Bugfix] Add Responses cache_write_tokens for API compat and CC parity (#57222)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-16 21:52:34 +00:00 |
|
|
Flora Feng
|
e0705731be
|
[Refactor] Remove unused interface methods (#57194)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-09-16 21:00:48 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
651a88c09a
|
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 10:57:24 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
|
18553c5c9f
|
[Kernel] Use Murmur3 RNG for Gumbel sampling (#51367)
Signed-off-by: freyfwt <110148731+freyfwt@users.noreply.github.com>
Signed-off-by: freyfwt <freytian1996@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-09-15 23:52:26 -07:00 |
|
|
shaohuaxiandCodex
|
e0301afb2a
|
[Bugfix][Responses] Clean up MCP tool sessions once before closing them (#56988)
Signed-off-by: 子华 <huaxi.shx@alibaba-inc.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-16 14:07:06 +08:00 |
|
|
Nicole LiHui 🥜andChauncey
|
7ef4d9bfed
|
[Bugfix][Responses] Fix browser.find action type (#55305)
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-09-11 12:07:04 +00:00 |
|
|
wang.yuqi
|
fe4d4109c2
|
[Frontend][last/N] Move all non-OpenAI content out of the OpenAI folder. (#56369)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-09-11 05:33:26 +00:00 |
|
|
|
ea40bb9e90
|
[feature] Watermarked generation and detection (Gumbel-max algorithm) (#54053)
Signed-off-by: Raphael Rialland <raphael.rialland@mistral.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 21:00:15 -07:00 |
|
|
Adababyandshaolila
|
5133e1d285
|
[Frontend] Migrate input-validation errors to VLLMValidationError (harmony/mistral/chat_utils/params) (#55735)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-08 06:45:40 +00:00 |
|
|
Adababyandshaolila
|
167858ea17
|
[Frontend] Migrate Responses harmony input validation to VLLMValidationError (#55701)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-07 13:30:11 +00:00 |
|
|
Francisco Javier ArceoandOpenAI Codex
|
6a2a2bb02b
|
[Frontend] Add stateless /v1/responses/render endpoint (#50195)
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-07 12:50:42 +00:00 |
|
|
Adababyandshaolila
|
7dbe386833
|
[Frontend] Migrate Responses API validation errors to VLLMValidationError (#50257)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-07 17:33:51 +08:00 |
|
|
|
e962733e08
|
[Security] Validate cache salts before they reach LMCache (#51444)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-05 03:56:06 +00:00 |
|
|
Bugen Zhao
|
d6bce42983
|
[Rust Frontend] Report reasoning tokens in chat completion usage (#54883)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-03 16:47:24 -07:00 |
|
|
Pratham ShirbhateandCyrus Leung
|
0ad5652a52
|
[Bugfix][Frontend] Restore the chat template content format mismatch warning (#54622)
Signed-off-by: Pratham Shirbhate <prathamshirbhate1909@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-01 18:17:54 +00:00 |
|
|
Chauncey
|
339e16cbb6
|
[Bugfix] Support MCP SDK 2.x tool input schemas (#53870)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-09-01 11:02:39 -04:00 |
|
|
Nicolò Lucchesi
|
dafbef15a1
|
[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-08-31 14:26:49 +00:00 |
|
|
wang.yuqiandCyrus Leung
|
eeb549a74d
|
[Frontend] Move engine/protocol.py out openai folder (#54492)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-31 10:13:50 +00:00 |
|
|
Kaif KohariandCyrus Leung
|
7fbfca2670
|
[Bugfix][Frontend] Only echo the assistant turn in batched chat completions (#52529)
Signed-off-by: Kaif <kaifkohari10@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-08-29 09:44:17 -07:00 |
|
|
wang.yuqi
|
735daf8ef6
|
[Frontend] Move cli_args.py and dp_supervisor.py out openai folder (#53659)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-25 07:02:32 +00:00 |
|
|
wang.yuqi
|
9cef631f30
|
[Frontend] Move run_batch.py out openai folder (#53500)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-24 15:04:10 +00:00 |
|
|
Tan ChaoandClaude
|
e239947777
|
[Bugfix][Frontend] Fix run_batch upload retrying on success and unawaited error body (#50588)
Signed-off-by: Chao Tan <chaos.tc@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-24 11:33:44 +00:00 |
|
|
Clinton ThomasandLucas Bourtoule
|
2ec6f0d71e
|
Reject oversized media before fully downloading it (#51896)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
|
2026-08-24 01:15:09 +00:00 |
|
|
Dieter Schwarzmann
|
585bb07c70
|
feat: add SSE keep-alive comments for idle streaming responses (#51034)
Signed-off-by: fuzzifikation <40043768+fuzzifikation@users.noreply.github.com>
|
2026-08-23 18:13:02 -07:00 |
|
|
Tan Chao
|
1baf372bfc
|
[Frontend] Use VLLMValidationError for batch request URL validation (#50191)
Signed-off-by: Chao Tan <chaos.tc@gmail.com>
|
2026-08-21 09:07:24 -07:00 |
|
|
Greg Pereira
|
18aa245a99
|
using existing uvicorn configuration for dp supervisor (#52473)
Signed-off-by: Gregory Pereira <grpereir@redhat.com>
|
2026-08-21 09:06:54 -07:00 |
|
|
|
7cfb97e337
|
[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)
Signed-off-by: Matthew Kotila <7692737+matthewkotila@users.noreply.github.com>
Co-authored-by: Reed Meyerson <31574681+reed-meyerson@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-08-20 15:42:49 -07:00 |
|
|
|
3a386cfaf5
|
[ROCm] Give EngineCore cleanup grace after request abort (#52281)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-19 11:39:59 -05:00 |
|
|
wang.yuqi
|
eac636a7fa
|
[Frontend] Move api_server.py out openai folder (#52131)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-19 09:43:46 +00:00 |
|
|
Vineeth Sai Varikuntla
|
86a89a9348
|
[Bugfix][Frontend] Run the serve arg checks for vllm launch too (#52825)
Signed-off-by: Vineeth Sai <vineethsai4444@gmail.com>
|
2026-08-19 04:48:50 +00:00 |
|
|
Yufeng He
|
5c9ff5366b
|
[Bugfix] Accept logprobs=-1 in the Completion API (#46175)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
|
2026-08-18 08:22:13 +00:00 |
|
|
|
c89d692cb5
|
[Build] Propagate vLLM version to Rust binaries (#52593)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 23:37:37 -07:00 |
|
|
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ac2ae8798c
|
[Frontend] Support count_reasoning_tokens in the Streaming Parser Engine (#45802)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-15 06:51:14 -07:00 |
|
|
|
7553aac77b
|
[Frontend] Add routed-experts prompt offset (#51906)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-13 08:09:00 -07:00 |
|