iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,297 Commits 3 Branches 0 Tags
main
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Bugen ZhaoandClaude Opus 5.5 8fa5ae844a [Frontend] Let an unset --tool-strict-level fall back to the tool parser's default (#61328) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-15 15:48:38 +08:00
Bugen ZhaoandClaude Opus 5.5 5a09062632 [Rust Frontend] Compose answer constraints into parser-owned output grammars (#60781) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-12 09:43:48 +00:00
Bugen ZhaoClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		0466bd36ea [Rust Frontend] Build the Kimi K3 full-output grammar from its parser mode (#59190) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-12 09:43:47 +00:00
Bugen ZhaoandClaude Opus 5.5 35e920d671 [Rust Frontend] Support --stream-interval and per-request stream_interval (#60589) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 14:10:42 -07:00
Bugen ZhaoandClaude Opus 5.5 5dc9bcd8cd [Rust Frontend] Pass reasoning controls through render -> generate (#60546) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 11:04:49 -07:00
Bugen ZhaoandClaude Opus 5.5 ce4603cad6 [Bugfix][Rust Frontend] Pass through raw characters in byte-level decode (#59861) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 11:04:00 -07:00
Bugen ZhaoandClaude Opus 5.5 9a585c62aa [Rust Frontend] Box rarely-set fields of per-token output types (#60588) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 11:01:16 -07:00
Bugen ZhaoOpenAI CodexClaude Opus 5.5
 		f226af0e11 [Bugfix] Eliminate frontend ZMQ port TOCTOU with inherited listeners (#54113) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-08 06:25:27 +00:00
Bugen ZhaoandClaude Opus 5.5 bc8dd4ad27 [Rust Frontend] Share SchemaRoot between argument coercion and grammars (#59408) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-07 08:28:27 +00:00
Bugen ZhaoandClaude Opus 5.5 7436a7f119 [Rust Frontend] Backtrack from safe text at a complete marker (#59563) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-07 07:45:15 +00:00
Bugen ZhaoandClaude Opus 5.5 0719975cee [CI][Rust Frontend] Pass --locked to cargo binstall (#60182) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-06 22:53:17 +08:00
Bugen ZhaoandClaude Opus 5.5 6bbad6acdf [Rust Frontend] Pass tool defer_loading through to chat templates (#60203) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-10-06 18:00:15 +08:00
Bugen ZhaoandClaude Opus 5.5 b3082d3044 [Rust Frontend] Remove the PyO3 tool-parser bridge (#59744) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-06 05:46:27 +00:00
Bugen ZhaoandClaude Opus 5.5 5145e35e50 [Frontend] Port the MiniMax M3 tool parser to the parser engine (#59743) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-06 05:46:27 +00:00
Bugen ZhaoandClaude Opus 5.5 24fb5fc08c [Rust Frontend] Add hf parser for response templates (#59005) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-01 08:16:38 +00:00
Bugen ZhaoandClaude Opus 5.5 b2d3a3b9ad [Rust Frontend] Split argument grammars into schema resolution and per-model rendering (#59395) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-01 05:43:18 +00:00
Bugen ZhaoClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		ac9126e58a [Rust Frontend] Snapshot structural-tag grammars as readable outlines (#59393) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-01 05:09:43 +00:00
Bugen ZhaoandClaude Opus 5.5 36229e1337 [Rust Frontend] Token-aware marker parsing for Kimi K3 (#58358) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-01 04:21:50 +00:00
Bugen ZhaoandClaude Opus 5.5 ec5ef92c87 [Rust Frontend] Anchor tokens after pending UTF-8 bytes at their own first byte (#58357) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Bugen Zhao <bugen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-01 04:21:50 +00:00
Bugen ZhaoandClaude Opus 5.5 87228cff01 [Rust Frontend] Replay roundtrip output grammars through XGrammar (#59143) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 07:29:01 +00:00
Bugen ZhaoandClaude Sonnet 5.5 8039d3cbfd [Rust Frontend] Use the MiMo structural-tag builder (#59148) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-09-30 01:34:46 +00:00
Bugen ZhaoandClaude Opus 5.5 afac509a33 [Bugfix][Rust Frontend] Skip engine-derived metrics under --disable-log-stats (#59205) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-29 11:01:54 -07:00
Bugen ZhaoandClaude Opus 5.5 e05095c9e1 [Rust Frontend] Feed parser tests and benchmarks attributed input (#59048) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-29 06:23:54 +00:00
Bugen ZhaoandClaude Opus 5.5 28f6739576 [Rust Frontend] Relax schema-aware tool argument conversion (#59004) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-29 05:40:41 +00:00
Bugen ZhaoClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		1f0bc49ee6 [Structured Outputs] Parse Lark grammars natively in the xgrammar backend (#58321) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-25 04:35:10 +00:00
Bugen Zhaojthomson04Claude Opus 5.5
 		055f150df5 [Perf][Rust Frontend] Make histogram observations lock-free (#58574) 
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-25 10:25:10 +08:00
Bugen ZhaoClaude Opus 5.5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e028554a1f [Rust Frontend] Support --sse-keep-alive-interval (#58306) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-24 06:19:14 +00:00
Bugen ZhaoandClaude Opus 5.5 a1b6763df6 [Rust Frontend] Accept custom chat roles for HF templates (#58311) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-24 13:43:34 +08:00
Bugen ZhaoandClaude Opus 5.5 a5603f21ae [Rust Frontend] Recognize new frontend-owned serve args as unsupported or no-op (#58330) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-24 13:43:24 +08:00
Bugen ZhaoandCodex 81d7293c21 [Rust Frontend] Construct model-owned vision processors through specs (#58109) 
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-22 10:01:53 +00:00
Bugen Zhao a6c47fbbf4 [Rust Frontend] Separate multimodal instrumentation from request timing (#58084) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-22 06:57:56 +00:00
Bugen ZhaoandCodex 496c6472cb [Rust Frontend] Build full-output grammars from initialized reasoning parsers (#57340) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-22 06:11:55 +00:00
Bugen ZhaoandClaude Fable 5.1 d50723df04 [Rust Frontend] Introduce parser-owned output grammar interfaces (#55269) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-22 05:35:07 +00:00
Bugen ZhaoandCodex ff3c9cba3f [Rust Frontend] Add MiMo V2.5 parser support (#57933) 
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-22 04:27:09 +00:00
Bugen ZhaoCodexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c58532c86b [Frontend] Upgrade XGrammar to 0.2.7 and Rust structural tags to 0.3.0 (#57272) 
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-18 11:44:05 +00:00
Bugen Zhao e52da038d1 [Rust Frontend] Normalize native renderer reasoning controls (#56998) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-16 18:15:05 -07:00
Bugen Zhao bfd713bf8b [Rust Frontend] Support HF config overrides --hf-overrides (#56931) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-16 02:52:55 +00:00
Bugen ZhaoandCodex 78eaaad2c7 [Rust Frontend] Add iteration token histogram (#56990) 
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-15 12:12:15 +00:00
Bugen Zhao cf1584f373 [Refactor] Normalize DeepSeek V4.1 model package naming (#56741) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-13 23:17:50 -07:00
Bugen Zhao eed1f3d0c6 [Rust Frontend] Support generation blocks in HF chat template (#56378) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-12 04:56:55 +00:00
Bugen ZhaoandCodex 485421b1c3 [Rust Frontend] Honor HF revisions, offline mode, and cache directory (#56386) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-12 03:39:17 +00:00
Bugen ZhaoandIsotr0py b47b01cf33 [Model][Frontend] Support DeepSeek-V4.1-Flash in Rust and Python frontends (#56208) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
 2026-09-10 01:15:06 -07:00
Bugen ZhaoCodexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		41cffa9af0 [Rust Frontend] Strongly type wire dtypes and multimodal modalities (#56174) 
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-10 02:11:22 +00:00
Bugen Zhao 285cbce6bd [Rust Frontend] Resolve unified and split parser selections consistently (#56018) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-09 18:19:30 -07:00
Bugen ZhaoandCodex fc6b6e1feb [Rust Frontend] Correctly parse whitespace framing in model output (#55417) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-09 13:40:13 +10:00
Bugen ZhaoandCodex 050f29caf1 [Rust Frontend] Simplify reasoning parser initialization and test organization (#55411) 
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-09 10:57:15 +08:00
Bugen Zhao d6bce42983 [Rust Frontend] Report reasoning tokens in chat completion usage (#54883) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-03 16:47:24 -07:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 21a2211040 [Rust Frontend] Use token-attributed text in reasoning and unified parsers (#54884) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-04 02:05:05 +08:00
Bugen Zhao ad127d9a0f [Perf][Rust Frontend] Coalesce decoded chunks per engine update (#55012) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-02 15:44:23 -07:00
Bugen ZhaoandCodex 80389cfedd [CI/Build] Gate PR title check on ready PRs & use slim runners (#54827) 
Co-authored-by: Codex <codex@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-01 23:12:00 +00:00
Bugen Zhao b911fe85c4 [Rust Frontend] Attribute decoded text to tokens (#52910) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-01 22:25:31 +00:00
Bugen Zhao 3439bad37e [Rust Frontend] Bound recursive argument parsers (#54303) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-09-01 12:45:50 -07:00
Bugen Zhao b131311fb4 [CI/Build] Add advisory PR title format check (#54263) 2026-08-28 15:50:47 -07:00
Bugen Zhao 11012d2a35 [Rust Frontend] Reduce copy in auxiliary frame resolution (#54148) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-08-28 09:01:17 -07:00
Bugen ZhaoandNick Hill 9db222c6be [Rust Frontend] Align OpenAI request and response edge cases (#53218) 
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-08-27 19:23:38 +00:00
Bugen ZhaoandOpenAI Codex 08b73d07cc [Frontend] Prevent Kimi K3 reserved markers in response text (#52889) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-08-21 09:06:52 -07:00
Bugen Zhao df3b3422b4 [Rust Frontend] Add HY3 unified parser and local XGrammar structural-tag builder (#53054) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-08-20 19:13:54 -07:00
Bugen ZhaoOpenAI CodexNick Hill
 		83c5d59209 [Rust Frontend] Replace external protoc with pure Rust lib protox (#52892) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-20 18:43:51 -07:00
Bugen Zhao f32b17b6d6 [Rust Frontend] Support --generation-config vllm (#53044) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-08-20 17:31:25 -07:00
Bugen ZhaoandNick Hill 41f179b57a [Rust Frontend] Simplify data-parallel size ownership (#52575) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-18 09:06:05 +00:00
Bugen ZhaoNick HillAndreas Karatzas
 		c89d692cb5 [Build] Propagate vLLM version to Rust binaries (#52593) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-17 23:37:37 -07:00
Bugen ZhaoOpenAI CodexNick Hill
 		5ae2d38821 [Perf][Structured Output] Skip unused request-local reasoners (#52573) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-17 16:30:41 -07:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> f1e921b6d6 [Rust Frontend] Support dynamic tools from developer messages (#51144) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-10 18:30:38 -07:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> d8c70f2243 [Rust Frontend] Upgrade MiniJinja to 2.22 & remove method lookup workaround (#51235) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-11 00:23:24 +00:00
Bugen ZhaoOpenAI CodexNick Hill
 		7b9f2dad89 [Frontend] Watch frontend processes during engine startup (#43417) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-06 11:17:24 -07:00
Bugen Zhao 7743486190 [Frontend] DeepSeek V4 0731 reasoning effort prompts & mappings (#50580) 2026-08-04 08:51:32 -07:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 0b1c151cbc [Rust Frontend] Align tool rendering for Kimi K3 (#50540) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-08-04 08:03:46 +00:00
Bugen Zhao ab98034d4c [Frontend][Bugfix] Use default tool call IDs for Kimi K3 for conversation-level uniqueness (#50420) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-31 10:02:17 +08:00
Bugen ZhaoandOpenAI Codex e9096fcb12 [Rust Frontend] Improve startup failure and readiness logs (#50406) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-30 14:18:17 -07:00
Bugen Zhao 629a938a92 [Frontend] Preserve bare Inkling text in Python and Rust parsers (#50403) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-30 12:25:10 -07:00
Bugen Zhao f5a7cce9b6 [Model] Add Kimi K3 support: Python frontend [2/2] (#50093) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-29 01:06:01 -07:00
Bugen Zhao d552a68645 [Rust Frontend] Extract shared tracing setup logic into vllm-tracing (#50129) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 19:31:15 +00:00
Bugen Zhao 01661cc57f [Rust][Benchmark] Make vllm bench serve Rust delegation opt-in (#50081) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 16:21:12 +00:00
Bugen ZhaoandOpenAI Codex 5ed3faa43d [Rust Frontend] Add ordinary-text tokenizer encoding (#49992) 
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 15:46:51 +08:00
Bugen ZhaoandOpenAI Codex fd9d2ede6f [Rust Frontend] Keep --max-model-len engine-owned (#49944) 
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-27 14:50:08 +08:00
Bugen Zhao eb44b3aaa4 [Rust][Benchmark] Use async HTTP clients (#49295) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-21 16:53:57 +08:00
Bugen Zhao 8688a06d67 [Rust][Benchmark] Use tracing for logs (#48937) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-21 05:18:13 +00:00
Bugen Zhao e2d7adeb64 [Rust Frontend] Bump xgrammar-structural-tag and enable local extension (#49161) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-20 16:22:24 +01:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c01618fdc8 [Rust][Benchmark] Integrate vllm-bench to vllm-rs & vllm CLI (#48930) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-20 09:31:25 +00:00
Bugen ZhaoIsotr0pymergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e281ac663a [Rust Frontend] Integrate MM audio support (#48554) 
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-07-15 15:00:17 +08:00
Bugen Zhao 487dfb3418 [CI] Add SPDX license header to Rust/Protobuf sources (#48472) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-13 10:22:47 +01:00
Bugen Zhao 27c3e579f0 [CI][Rust Frontend] Pin cargo tool versions (#48222) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-12 16:34:26 +01:00
Bugen Zhao 074bdd0d99 [Rust Frontend] Integrate MM video support (#47959) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-10 08:15:33 +00:00
Bugen Zhao 2cae98dfa5 [Rust Frontend] Handle continue_final_message with renderer sentinel (#47844) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-08 12:57:04 +01:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> e55cc59e52 [Rust Frontend][CI] Unblock more end-to-end test cases (#47735) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-07 08:27:20 +00:00
Bugen Zhaoandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8f4c69b222 [Rust Frontend] Cache metric handles for scheduler & request stats (#47444) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-06 13:02:59 +00:00
Bugen Zhao ab3b6d97aa [Frontend] Limit SO_REUSEPORT to multi-worker serving (#47529) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-04 01:26:24 +00:00
Bugen Zhao 8651f043b8 [Rust Frontend] Speed up chat roundtrip tests (#47523) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-03 19:25:06 +01:00
Bugen Zhao b790c84cde [CI] Enable sccache for Rust build under CUDA/ROCm (#45246) 2026-07-02 23:45:41 -07:00
Bugen Zhao ec0ffaacc8 [Rust Frontend] Improve scheduler stats logging parity (#47435) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-02 15:55:25 +01:00
Bugen Zhao 25fcb65d51 [Rust Frontend] Use enum-backed domain types for engine outputs and structured outputs (#47283) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-02 10:41:46 +01:00
Bugen Zhao c638f9216a [Rust Frontend] Split engine core DTOs into separate modules (#47265) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-01 15:28:21 +01:00
Bugen Zhao 7a327f0b4f [Rust Frontend] Simplify unit tests with shared TestTokenizer (#47125) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-30 15:34:43 +01:00
Bugen Zhao 3675bcff67 [Rust Frontend] Refactor TLS serve path with unified MaybeTlsListener (#47101) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-30 14:31:58 +01:00
Bugen Zhao bdbd7278b6 [Rust Frontend] Extend renderer/parser roundtrip tests to support token ids (#47110) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-30 14:27:45 +01:00
Bugen Zhao 5274c1181d [Rust Frontend] Add Harmony Renderer for GPT-OSS (#46800) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-29 03:39:04 +00:00
Bugen Zhao e71bc6da85 [Rust Frontend] Use oss-harmony for Harmony output processing (#46799) 2026-06-26 08:24:13 -07:00
Bugen Zhao ae7c8ec223 [Rust Frontend] Switch rustls to native-tls/OpenSSL (#46696) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-25 17:19:44 -07:00
Bugen Zhao 1d3f4cb3a4 [Rust Frontend] Extract renderer fixture test utilities (#46719) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-25 17:12:38 -07:00
Bugen Zhao f9e684499f [Rust Frontend] Migrate gemma4 to unified parser (#46602) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-25 16:59:57 -07:00