 Cyrus Leung
|
c8824a1e42
|
[MM] Move supports_multimodal_inputs and cache out of registry (#57913)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-21 07:43:07 -07:00 |
|
|
|
10e6a7f210
|
[Frontend] Expose per-request spec decode metrics in generate API (#43310)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <codex@openai.com>
|
2026-09-20 12:21:33 +00:00 |
|
|
Dilber
|
27b7757f63
|
[Bugfix][Frontend] Bound the prompt after multimodal expansion (#57076)
Signed-off-by: Dilber P Shakir <dilbersha@gmail.com>
|
2026-09-20 08:52:27 +00:00 |
|
|
Cyrus Leung
|
751f6807d9
|
[Refactor] Use dynamic MM cache in processor (#57674)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-19 15:38:00 +00:00 |
|
|
Cyrus Leung
|
56cac80b14
|
[Deprecation] Remove assistant_token_mask support (#57520)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-09-19 00:17:51 +08:00 |
|
|
Martin Hickey
|
70164bdadc
|
[Frontend] Add stream reasoning and tool calls from the derender endpoint (#50550)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-09-18 16:36:27 +02:00 |
|
|
|
cc09352e5c
|
[Bugfix][Multimodal] Preserve DeepSeek V4 image block spacing (#56882)
Signed-off-by: Xucheng Zhou <aden1350@outlook.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-18 18:44:39 +08:00 |
|
|
|
dee37d8911
|
[Frontend] Add --tool-strict-level for server-side control for structural tag activation (#56268)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: lazymio <mio@lazym.io>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-09-18 04:32:39 +00:00 |
|
|
Harry MellorandClaude Opus 5
|
651a88c09a
|
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 10:57:24 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
|
323a29d8f2
|
[Bugfix] Unreadable prompt_embeds payload should be a 400, not a 500 (#55451)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-16 05:53:36 +00:00 |
|
|
Tianyu Guo
|
fa1b3b1922
|
[Bugfix][EPD] Preserve explicit multimodal UUIDs with caches disabled (#56432)
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
|
2026-09-13 10:08:30 +00:00 |
|
|
Walter Beller-MoralesandFlora Feng
|
756794a9a7
|
[Frontend] create unified Cohere parser (#56392)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-09-12 04:04:46 -04:00 |
|
|
Bugen ZhaoandIsotr0py
|
b47b01cf33
|
[Model][Frontend] Support DeepSeek-V4.1-Flash in Rust and Python frontends (#56208)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 01:15:06 -07:00 |
|
|
|
56d001faf0
|
[Bugfix] Detect OpenAI content format when message.content is passed through macro parameters (#53824)
Signed-off-by: wuhangxian <1391938827@qq.com>
Signed-off-by: wuhangxian <wuhangxian@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: wuhangxian <wuhangxian@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-09 20:10:28 +00:00 |
|
|
Adababyandshaolila
|
5133e1d285
|
[Frontend] Migrate input-validation errors to VLLMValidationError (harmony/mistral/chat_utils/params) (#55735)
Signed-off-by: shaolila <shaolila@buaa.edu.cn>
Co-authored-by: shaolila <shaolila@buaa.edu.cn>
|
2026-09-08 06:45:40 +00:00 |
|
|
Taneem Ibrahim
|
252ed87621
|
[Bugfix] Restore Responses validation error boundary (#55761)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-09-07 22:12:18 +00:00 |
|
|
Francisco Javier ArceoandOpenAI Codex
|
6a2a2bb02b
|
[Frontend] Add stateless /v1/responses/render endpoint (#50195)
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-07 12:50:42 +00:00 |
|
|
frankieandTrae Agent
|
9cc7793e32
|
[Bugfix] Gracefully handle unsupported reasoning_effort in chat templates (#54022)
Signed-off-by: frankie <wangyongsheng686@gmail.com>
Co-authored-by: Trae Agent <noreply@trae.ai>
|
2026-09-06 21:11:35 -07:00 |
|
|
lucamotzandOpenAI Codex
|
f4eccdadef
|
[Bugfix][Multimodal] Bound renderer warmup to the prefill token budget (#55448)
Signed-off-by: Luca Motz <luca.motz@icloud.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-09-05 16:43:28 +00:00 |
|
|
Ning XieandCyrus Leung
|
2a336d8239
|
[warmup] overlap renderer warmup and engine core initialization (#54557)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-03 19:44:21 +00:00 |
|
|
waizuichougou
|
d98bb2a879
|
[Bugfix][Frontend] Honor skip_decoder_start_token in async encoder-decoder rendering (#54799)
Signed-off-by: waizuichougou <2082431897@qq.com>
|
2026-09-01 19:00:28 +00:00 |
|
|
Pratham ShirbhateandCyrus Leung
|
0ad5652a52
|
[Bugfix][Frontend] Restore the chat template content format mismatch warning (#54622)
Signed-off-by: Pratham Shirbhate <prathamshirbhate1909@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-01 18:17:54 +00:00 |
|
|
Jan Kwieciński
|
1f1f628859
|
[Feat][MM Hashing] include media_io_kwargs in multi-modal hashes (#54241)
Signed-off-by: Jan Kwiecinski <jkwiecinski@nvidia.com>
|
2026-09-01 13:17:01 +00:00 |
|
|
lzhan011andCyrus Leung
|
ce7391712b
|
[Bugfix][Security] Bound embedding densification before to_dense() (#54632)
Signed-off-by: lzhan011 <35493221+lzhan011@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-09-01 08:45:14 +00:00 |
|
|
waizuichougou
|
8905633687
|
[Bugfix][Frontend] Preserve token offset origins after left text pre-trimming (#54692)
Signed-off-by: waizuichougou <2082431897@qq.com>
|
2026-09-01 08:02:56 +00:00 |
|
|
Hotragn Pettugani
|
ff0c3cb03c
|
[Bugfix][Frontend] Truncate the assistant tokens mask with the prompt (#54539)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
|
2026-09-01 05:53:22 +00:00 |
|
|
wang.yuqiandCyrus Leung
|
eeb549a74d
|
[Frontend] Move engine/protocol.py out openai folder (#54492)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-08-31 10:13:50 +00:00 |
|
|
Hotragn Pettugani
|
28bf75c9a9
|
[Bugfix][Frontend] Truncate prompt_is_token_ids with the prompt (#54509)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
|
2026-08-31 09:29:01 +00:00 |
|
|
wang.yuqi
|
5bfd76372d
|
[Renderer] Shutdown the renderer properly. (#52124)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-31 08:40:37 +00:00 |
|
|
Hotragn Pettugani
|
8fd9eb85d5
|
[Bugfix][Frontend] Truncate prompt_token_offsets with the prompt (#54407)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
|
2026-08-31 06:13:37 +00:00 |
|
|
Hotragn Pettugani
|
687db59744
|
[Bugfix][Frontend] Truncate pooling prompts before padding them (#54364)
Signed-off-by: hotragn <hotragn.pettugani_2024@woxsen.edu.in>
|
2026-08-30 22:12:03 -07:00 |
|
|
Kevin H. Luu
|
d04d3e0a07
|
[Bugfix] Revert renderer warmup overlap to avoid fork deadlock (#54023)
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
|
2026-08-27 16:36:33 -07:00 |
|
|
Ning Xie
|
ca90b9e7d4
|
[warmup] overlap renderer warmup and engine core initialization (#52764)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
|
2026-08-27 11:42:08 +08:00 |
|
|
Cyrus LeungandQwen Code
|
ebcd606467
|
[MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
|
2026-08-23 14:50:32 +08:00 |
|
|
andrewbcohere
|
f94dcde5c5
|
Fix Cohere ChatV2 citation and tool handling issues (#52175)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
|
2026-08-21 15:23:17 -07:00 |
|
|
Cyrus Leung
|
4666a8ba9e
|
[Refactor] Remove InputPreprocessor (#53064)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-08-20 08:39:48 +00:00 |
|
|
wang.yuqi
|
b8165e5e58
|
[Frontend] Consolidate entrypoint exception handler (#52261)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-08-14 09:27:24 +00:00 |
|
|
JasonCohere
|
5fee0a872d
|
chore: Upstream Cohere parser fixes + tests (#51998)
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
|
2026-08-13 05:05:36 -07:00 |
|
|
Clinton ThomasandLucas Bourtoule
|
90fd4a333f
|
Preserve revision pins in secondary artifact loaders (#51446)
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com>
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com>
|
2026-08-11 04:33:10 +00:00 |
|
|
yzong-rh
|
dc818c198d
|
[GPT-OSS] Strict tool call and constrained decoding for Harmony (#45560)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-08-01 12:10:26 -04:00 |
|
|
andrewbcohereandCyrus Leung
|
9c110fa522
|
[Frontend] Cohere chat v2 api support (#47189)
Signed-off-by: Andrew Berneshawi <andrewberneshawi@cohere.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-07-31 22:53:54 -07:00 |
|
|
wang.yuqi
|
f5ffc59b6a
|
[Renderer] Warm up the renderer properly. (#50408)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-31 11:46:53 +00:00 |
|
|
Isotr0py
|
1180b604f8
|
[Multimodal] Expose mm hash algothrim selection to cli args (#49686)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-31 05:25:19 +00:00 |
|
|
Martin Hickey
|
0a31372e5f
|
[Frontend] Add detokenization streaming derender for disaggregated serving (#47301)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-07-29 18:01:20 -07:00 |
|
|
Bugen Zhao
|
f5a7cce9b6
|
[Model] Add Kimi K3 support: Python frontend [2/2] (#50093)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-29 01:06:01 -07:00 |
|
|
Seiji Eicher
|
6370e53f24
|
[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
|
2026-07-29 10:02:57 +02:00 |
|
|
Guan-Ming Chiu
|
8d28b48d01
|
[Perf] Isolate MM preprocessing on its own executor (#49524)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-07-26 08:04:17 +00:00 |
|
|
Guan-Ming Chiu
|
2dc5a72e7e
|
[Bugfix][Renderer] Rebuild vision chunk UUIDs in async render path (#49400)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-07-22 14:11:24 +00:00 |
|
|
Guan-Ming Chiu
|
9df2f91232
|
[Renderer] Offload derender CPU work to renderer thread pool (#49396)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-07-22 06:55:03 +00:00 |
|