|
3962042304
|
[Bugfix][V1][Multimodal] Recover from P0/P1 processor cache drift (#46747) (#46747)
Signed-off-by: William Zhao <williamzh@meta.com>
Signed-off-by: WillZZZy <93454470+WillZZZy@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-08-12 12:06:57 +08:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f1e921b6d6
|
[Rust Frontend] Support dynamic tools from developer messages (#51144)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-10 18:30:38 -07:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
d8c70f2243
|
[Rust Frontend] Upgrade MiniJinja to 2.22 & remove method lookup workaround (#51235)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-11 00:23:24 +00:00 |
|
|
Sage
|
865781e627
|
[Rust Frontend] Add standalone Rust renderer (#50289)
|
2026-08-06 11:23:26 +00:00 |
|
|
SageandBugen Zhao
|
5bf32605a9
|
[Rust Frontend] Deduplicate request preprocessing for /tokenize (#50448)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-05 08:27:35 +00:00 |
|
|
Bugen Zhao
|
7743486190
|
[Frontend] DeepSeek V4 0731 reasoning effort prompts & mappings (#50580)
|
2026-08-04 08:51:32 -07:00 |
|
|
Connor CarpenterandBugen Zhao
|
e98a8774cb
|
[Rust Frontend][gRPC] Add multimodal image inference (#50368)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-04 09:34:31 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
0b1c151cbc
|
[Rust Frontend] Align tool rendering for Kimi K3 (#50540)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-08-04 08:03:46 +00:00 |
|
|
Karen Chung
|
f57123aa2d
|
feat(frontend): session id plumbing into requests (#48048)
Signed-off-by: Karen Chung <karenc@nvidia.com>
|
2026-08-03 22:18:58 +00:00 |
|
|
Bugen Zhao
|
ab98034d4c
|
[Frontend][Bugfix] Use default tool call IDs for Kimi K3 for conversation-level uniqueness (#50420)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-31 10:02:17 +08:00 |
|
|
ReidandBugen Zhao
|
242c591d5a
|
[Rust Frontend] Send multimodal tensors in auxiliary frames (#49341)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-29 12:21:09 +00:00 |
|
|
Maria Guevara
|
c44e191b01
|
[Rust Frontend] Add --limit-mm-per-prompt support (#49604)
Signed-off-by: Maria Guevara <kawaiiplush14@gmail.com>
|
2026-07-29 17:21:41 +08:00 |
|
|
Bugen Zhao
|
2899dca843
|
[Model] Add Kimi K3 support: Rust frontend [1/2] (#50104)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-28 14:31:13 -07:00 |
|
|
Bugen ZhaoandOpenAI Codex
|
5ed3faa43d
|
[Rust Frontend] Add ordinary-text tokenizer encoding (#49992)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-28 15:46:51 +08:00 |
|
|
Connor CarpenterandNick Hill
|
e3c2fc3b3c
|
[Rust Frontend][gRPC] Add server and model discovery (#49491)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-27 09:53:27 -07:00 |
|
|
Sage
|
0f6cf7f628
|
[Rust Frontend] Extract request preparation from the inference path (#49045)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-07-22 11:31:36 +00:00 |
|
|
Bugen Zhao
|
e2d7adeb64
|
[Rust Frontend] Bump xgrammar-structural-tag and enable local extension (#49161)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-20 16:22:24 +01:00 |
|
|
Reid
|
818cf61e91
|
[Rust Frontend] Fix macro-based content format detection (#49042)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-20 09:39:13 +00:00 |
|
|
Sageandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f1f1259692
|
[Rust Frontend] Use zero-copy slicing for multimodal tensors (#48781)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-07-20 16:28:25 +08:00 |
|
|
Chao-Ju Chenandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ea1d65fe6d
|
[Rust Frontend] Add Seed-OSS tool parser (#47741)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
|
2026-07-16 17:28:02 +08:00 |
|
|
|
6570c9800c
|
[Model] Add Inkling model support [1/N] (#48799)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-15 23:40:07 -07:00 |
|
|
Tahsin Tunan
|
4e04bcbce6
|
[Rust Frontend] Tolerate whitespace before the outer brace in JSON tool-call parsers (#48034)
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
|
2026-07-15 11:03:37 +00:00 |
|
|
|
e281ac663a
|
[Rust Frontend] Integrate MM audio support (#48554)
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-15 15:00:17 +08:00 |
|
|
Bugen Zhao
|
487dfb3418
|
[CI] Add SPDX license header to Rust/Protobuf sources (#48472)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-13 10:22:47 +01:00 |
|
|
omerpaz95andOr Ozeri
|
8df14cfc8c
|
[EC Connector] Add EC Transfer Params (#42433)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-07-12 14:35:33 +03:00 |
|
|
ReidandBugen Zhao
|
c241c7a2b0
|
[Rust Frontend] Add roundtrip fixtures for more chat parsers (#47883)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-10 10:03:58 +00:00 |
|
|
Bugen Zhao
|
074bdd0d99
|
[Rust Frontend] Integrate MM video support (#47959)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-10 08:15:33 +00:00 |
|
|
Bugen Zhao
|
2cae98dfa5
|
[Rust Frontend] Handle continue_final_message with renderer sentinel (#47844)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-08 12:57:04 +01:00 |
|
|
Tahsin Tunan
|
34e6dfced8
|
[Rust Frontend] Stamp arrival_time at the frontend entry (#47787)
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
|
2026-07-07 03:27:10 +00:00 |
|
|
Reid
|
a46c9329e5
|
[Rust Frontend] Add DeepSeek V3.2 roundtrip fixture (#47619)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-07 10:47:02 +08:00 |
|
|
Bugen Zhao
|
8651f043b8
|
[Rust Frontend] Speed up chat roundtrip tests (#47523)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 19:25:06 +01:00 |
|
|
Isotr0py
|
400a9c386d
|
[Rust Frontend] Bump llm-multimodal version (#47530)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-03 09:48:36 +00:00 |
|
|
Reid
|
9b8e76589d
|
[Rust Frontend] Recover buffered text from incomplete tool calls at EOS (#47289)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-03 03:45:03 +00:00 |
|
|
Bugen Zhao
|
25fcb65d51
|
[Rust Frontend] Use enum-backed domain types for engine outputs and structured outputs (#47283)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 10:41:46 +01:00 |
|
|
Bugen Zhao
|
c638f9216a
|
[Rust Frontend] Split engine core DTOs into separate modules (#47265)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-01 15:28:21 +01:00 |
|
|
Bugen Zhao
|
7a327f0b4f
|
[Rust Frontend] Simplify unit tests with shared TestTokenizer (#47125)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 15:34:43 +01:00 |
|
|
Bugen Zhao
|
bdbd7278b6
|
[Rust Frontend] Extend renderer/parser roundtrip tests to support token ids (#47110)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 14:27:45 +01:00 |
|
|
Bugen Zhao
|
5274c1181d
|
[Rust Frontend] Add Harmony Renderer for GPT-OSS (#46800)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-29 03:39:04 +00:00 |
|
|
ReidandBugen Zhao
|
d350fa8ddd
|
[Bugfix][Rust Frontend] Reject min_tokens above max_tokens (#46733)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-26 03:41:33 +00:00 |
|
|
Bugen Zhao
|
1d3f4cb3a4
|
[Rust Frontend] Extract renderer fixture test utilities (#46719)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 17:12:38 -07:00 |
|
|
Bugen Zhao
|
f9e684499f
|
[Rust Frontend] Migrate gemma4 to unified parser (#46602)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 16:59:57 -07:00 |
|
|
Bugen Zhao
|
4d3b4b9b01
|
[Rust Frontend] Make ToolParserOutput a seq of ToolParserEvent to preserve order (#46584)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 06:27:07 +00:00 |
|
|
Bugen Zhao
|
76c3c4ff63
|
[Rust Frontend] Introduce unified parser interface & combined parser (#46583)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 03:17:31 +00:00 |
|
|
Tiezhen WANGandClaude
|
4cd1a84c88
|
[Model] Remove BaiChuanForCausalLM and BaichuanForCausalLM (#46362)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-24 16:13:57 +08:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
ce9f64020b
|
[Rust Frontend] Pass effective reasoning_parser_kwargs for structured output (#46360)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 03:13:44 +00:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
4ed8eaafb0
|
[Rust Frontend] Integrate xgrammar-structural-tag for strict and required tool calling (#46057)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 10:46:49 +08:00 |
|
|
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
a8481be7a9
|
[Rust Frontend][Perf] Use dedicated runtime for HTTP/request-processing/ZMQ (#46051)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-23 04:03:20 +00:00 |
|
|
|
d14e551a53
|
[Model] Remove MiniMaxText01, MiniMaxVL01, MiniMaxForCausalLM (#45993)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-22 15:20:46 +08:00 |
|
|
Bugen Zhao
|
259ff891be
|
[Rust Frontend] Require ModelConfig.vocab_size to be present (#45696)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-16 05:30:25 +00:00 |
|
|
|
0a1c5034f5
|
[Model] Add MiniMax M3 support (#45381)
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-06-16 01:01:25 +08:00 |
|