MOVZX and Hinata
54a396586e
[Mini-VLLM] Repair test suite after SM86 cut
...
- Restore example connector, test helpers, and dropped patch tests
- Guard MLA metadata import in the example connector
- Point the PLE test at common.ops.ple after upstream #60021 move
- Cut tests for removed features: tools, DRY, epd proxy, STT batch,
diffusion scheduler, INC/Quark PLE cases, mamba-2 mixer
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-19 01:06:30 +07:00
MOVZX and Hinata
81074e94a3
[Mini-vLLM] Cut dead subsystems: models, entrypoints, backends, utils, tests
...
- Drop dead model modules, keeping files live imports require
- Remove anthropic, cohere, codegen entrypoints and batch STT modes
- Delete unused attention backends, MoE experts, and NPU/XPU util leaves
- Strip dead third_party trees and ROCm leaves with no CUDA path
- Remove mooncake EC connectors: dependency missing since branch base
- Re-audit verified by full import sweep and Qwen3.5 smoke test
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-19 00:20:48 +07:00
bzsuni and Flora Feng
338dab077c
[Bugfix] Fix Apertus streaming scientific notation ( #61812 )
...
Signed-off-by: bzsuni <bingzhe.sun@daocloud.io >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-15 16:49:57 +00:00
Bugen Zhao and Claude Opus 5.5
8fa5ae844a
[Frontend] Let an unset --tool-strict-level fall back to the tool parser's default ( #61328 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-15 15:48:38 +08:00
Shijin Zhang and Chauncey
83773ecdf3
[Frontend] Support CustomToolCall in the non-Harmony Responses API ( #57322 )
...
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-10-12 17:22:55 +08:00
e31b823bf5
[Bugfix][Tool Parser] Use LongCat tags in the LongCat structural tag ( #60747 )
...
Signed-off-by: hpdkhoa <hpdkhoa2311@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-08 21:20:54 -07:00
9824159d94
[Bugfix] Fix InternLM2 tool parser dropping characters from streamed arguments ( #60709 )
...
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-08 21:20:49 -07:00
Bugen Zhao and Claude Opus 5.5
b3082d3044
[Rust Frontend] Remove the PyO3 tool-parser bridge ( #59744 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-06 05:46:27 +00:00
Bugen Zhao and Claude Opus 5.5
5145e35e50
[Frontend] Port the MiniMax M3 tool parser to the parser engine ( #59743 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-06 05:46:27 +00:00
RomeJay and Flora Feng
2e06395fd3
[Bugfix][Frontend] Build tool-call grammars from the tools the prompt renders ( #59879 )
...
Signed-off-by: Rongjie Jiang <j1870831863@outlook.com >
Signed-off-by: sfeng33 <4florafeng@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-05 22:01:03 +00:00
Shijin Zhang and Flora Feng
d1a974c140
[Frontend] Constrain non-strict GLM-4.7 tool calls with a shallow structural tag ( #56403 )
...
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-10-02 14:31:53 -04:00
Flora Feng
a5105dba05
[Frontend] Port Step-3.5 parsers to the streaming parser engine ( #59321 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-10-01 22:18:37 +00:00
Harry Mellor and Claude Opus 5.5
fc2c801ad9
Disable mypy arg-type and assignment checks in tests ( #59428 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 15:18:50 +00:00
cherry77-cloud and Flora Feng
5e887a078b
[Bugfix] Route Step3p5 forced tool choices through XML parser ( #51810 )
...
Signed-off-by: taking-lying-flat <1615405@qq.com >
Signed-off-by: Flora Feng <4florafeng@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-29 21:58:46 +00:00
Ostring24 and Flora Feng
4e7af3b0de
[Bugfix][Frontend] Enforce parallel_tool_calls=false in the required-tool grammar ( #50502 )
...
Signed-off-by: ostring <ostring@qq.com >
Signed-off-by: sfeng33 <4florafeng@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-29 21:33:28 +00:00
hubunt and Flora Feng
19a4d66a0b
[Bugfix] Avoid JSON constraints for native tool parsers ( #47512 )
...
Signed-off-by: Flora Feng <4florafeng@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-29 19:37:12 +00:00
dfc8e0f3e2
[Frontend] Support strict MiMo-V2.6 tool calling ( #58019 )
...
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Signed-off-by: Ubospica <ubospica@gmail.com >
Signed-off-by: yuchuan <yuchuan.7streams@gmail.com >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-29 12:47:47 +00:00
Shinichi Hemmi
17cc3cd80e
[Model] Engine based plamo3 parser ( #56575 )
...
Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp >
2026-09-29 05:17:42 +00:00
15ed1262e7
[Bugfix][Tool Parser] Migrate Granite to the streaming Parser Engine ( #49648 )
...
Signed-off-by: Nikhil Kulkarni <nikhilkulkarni1755@gmail.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-09-23 10:37:40 +00:00
c58532c86b
[Frontend] Upgrade XGrammar to 0.2.7 and Rust structural tags to 0.3.0 ( #57272 )
...
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-18 11:44:05 +00:00
dee37d8911
[Frontend] Add --tool-strict-level for server-side control for structural tag activation ( #56268 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Bugen Zhao <i@bugenzhao.com >
Signed-off-by: lazymio <mio@lazym.io >
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-09-18 04:32:39 +00:00
Flora Feng
e0705731be
[Refactor] Remove unused interface methods ( #57194 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-09-16 21:00:48 +00:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
Yixin Dong and Flora Feng
2c2cbd84fd
[Frontend] Use XGrammar schema constraints for DeepSeek V4.1 ( #56408 )
...
Signed-off-by: Ubospica <ubospica@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-15 04:36:16 -04:00
wuhangxian and Chauncey
a529c1a748
[Bugfix] Handle bare and malformed tool call openers in Gemma4 parser ( #53444 )
...
Signed-off-by: wuhangxian <1391938827@qq.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-09-15 02:52:43 +00:00
Walter Beller-Morales and Flora Feng
756794a9a7
[Frontend] create unified Cohere parser ( #56392 )
...
Signed-off-by: walterbm <walter.beller.morales@gmail.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-09-12 04:04:46 -04:00
Bugen Zhao and Isotr0py
b47b01cf33
[Model][Frontend] Support DeepSeek-V4.1-Flash in Rust and Python frontends ( #56208 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-10 01:15:06 -07:00
Flora Feng
d98c8c030b
[Bugfix] Parse DSML tool calls when the model omits the tool_calls wrapper ( #55954 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-09-08 17:38:04 -07:00
Bowen Tan
1f76efaa21
[Model] Add K2-Horizon model support ( #55063 )
2026-09-03 01:17:08 -07:00
wang.yuqi and Cyrus Leung
eeb549a74d
[Frontend] Move engine/protocol.py out openai folder ( #54492 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: wang.yuqi <noooop@126.com >
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
2026-08-31 10:13:50 +00:00
Bugen Zhao and OpenAI Codex
08b73d07cc
[Frontend] Prevent Kimi K3 reserved markers in response text ( #52889 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-08-21 09:06:52 -07:00
JasonCohere
5fee0a872d
chore: Upstream Cohere parser fixes + tests ( #51998 )
...
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com >
2026-08-13 05:05:36 -07:00
9035151d6c
[Model] Add native Dots3 NOTE multimodal support ( #51255 )
...
Signed-off-by: KurodaKanbei <mistergalahad@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-08-12 23:13:20 +08:00
Zetian Li - ikun and Claude
7303c66f68
[Bugfix] Fix lfm2 tool parser dropping calls with brackets or newline… ( #48171 )
...
Signed-off-by: Zetian Li <804561096@qq.com >
Co-authored-by: Claude (Anthropic) <noreply@anthropic.com >
2026-08-10 15:10:06 +08:00
yzong-rh
dc818c198d
[GPT-OSS] Strict tool call and constrained decoding for Harmony ( #45560 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-08-01 12:10:26 -04:00
Julien Denize
1a20d23dab
[PARSER][Mistral] unified engine-based parser for reasoning and tool calls ( #48947 )
2026-07-30 15:38:00 +02:00
Bugen Zhao
f5a7cce9b6
[Model] Add Kimi K3 support: Python frontend [2/2] ( #50093 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-07-29 01:06:01 -07:00
mosya415 and mosya415
1423569ff5
[Bugfix][Tool Parser] Fix dropped streaming arguments in Jamba and InternLM2 parsers ( #48852 )
...
Signed-off-by: mosya415 <263250241+mosya415@users.noreply.github.com >
Co-authored-by: mosya415 <263250241+mosya415@users.noreply.github.com >
2026-07-25 09:34:43 -04:00
11d291511a
[Bugfix][Tool Parser] Preserve whitespace in parameter values (MiniMax M2, Qwen3, MiniCPM5 XML) ( #48846 )
...
Signed-off-by: mosya415 <263250241+mosya415@users.noreply.github.com >
Signed-off-by: Ben Browning <56071+bbrowning@users.noreply.github.com >
Co-authored-by: mosya415 <263250241+mosya415@users.noreply.github.com >
Co-authored-by: Ben Browning <56071+bbrowning@users.noreply.github.com >
2026-07-17 16:45:41 +00:00
Matt Woodson
af1f036a70
[Bugfix] Skip minimax_m3 tool parser tests when Rust extension is absent ( #48523 )
...
Signed-off-by: Matt Woodson <mwoodson@redhat.com >
2026-07-14 04:43:22 +00:00
akii96 and Andreas Karatzas
5769a7382c
[ROCm][CI][Bugfix] Fix flaky parallel tool-call streaming (test assertion + Mistral/Granite parsers) ( #47550 )
...
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
2026-07-06 19:06:19 -04:00
Zhong and zhongjing123
98ba9b9583
[Frontend] Support OpenAI Responses API namespace tools ( #47024 )
...
Signed-off-by: zhongjing123 <jimzhong5193@gmail.com >
Co-authored-by: zhongjing123 <jimzhong5193@gmail.com >
2026-07-06 06:21:27 +00:00
Harry Mellor
f1445f6dbd
[CI] Bump huggingface-hub from v1.10.2 to v1.22.0 ( #47551 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-07-04 07:45:45 -07:00
Ben Browning
fb5291b35b
[Frontend] [Parser] Port DeepSeek V4 to streaming parser engine framework ( #45877 )
...
Signed-off-by: Ben Browning <bbrownin@redhat.com >
2026-07-03 20:55:23 -04:00
Joe Rowell
258f8de91f
[Bugfix][Tool Parser] poolside_v1: accept tool calls without newline after function name ( #47311 )
...
Signed-off-by: Joe Rowell <joerowell4@gmail.com >
2026-07-02 12:08:37 -07:00
Joe Rowell and Robert Shaw
11b26c5528
[Bugfix][Tool Parser] PoolsideV1: fix logprobs AttributeError on Responses API ( #47138 )
...
Signed-off-by: Joe Rowell <joerowell4@gmail.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
2026-06-30 19:14:09 +00:00
Harry Mellor
5316638a5e
Fix transient dependency issues caused by requirements/common.txt ( #47015 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-06-29 14:20:33 -07:00
Joe Rowell
63e161f296
[Bugfix][Tool Parser] PoolsideV1: fix string whitespace and required named tool choice ( #46486 )
...
Signed-off-by: Joe Rowell <joerowell4@gmail.com >
2026-06-26 06:05:16 +00:00
Bugen Zhao
4d3b4b9b01
[Rust Frontend] Make ToolParserOutput a seq of ToolParserEvent to preserve order ( #46584 )
...
Signed-off-by: Bugen Zhao <i@bugenzhao.com >
2026-06-25 06:27:07 +00:00