iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
ChaunceyandCyrus Leung e1726d9142 [Frontend] Add cache salt and tracing to openai decisions (#61550) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-10-14 00:48:44 -07:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> ad8d39cbab [Bugfix] Fix DSpark graph-padding handling in the DeepSeek-V4.1 MoE fused top-k (#59166) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-10-14 07:49:52 +08:00
Chauncey ac28877f0e [Bugfix] Fix out-of-bounds lookahead in adaptive block verification (#60945) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-10-12 09:21:35 -04:00
Chauncey fa5cfd48d5 [Refactor] Deduplicate trace header handling in BaseServing (#60828) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-10-10 05:27:58 +00:00
Chauncey 3e2a7e74a5 [Feat][Model] Enable KDA prefill checkpoints for GLM-5.3-Flash (#56960) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-29 09:14:30 +00:00
Chauncey 61349e342d [Misc] Avoid repeated warnings for merged Anthropic system messages (#59172) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-29 01:31:22 -07:00
Chaunceyandzjy0516 3df4ae153e [Core][KDA] Generalize Mamba prefill checkpoint builder and exporter (#57783) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-09-21 04:46:11 +00:00
Chauncey bf01fc4a31 [GLM-5.3-Flash] Route kpool indexer top-k through the shared SparseIndexerTopk dispatcher (#57546) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-20 11:17:59 +00:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2bbdfcfcfe [Perf][GLM5.3-Flash] Use cooperative top-k for small GLM decode batches (#57327) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-18 10:31:35 +08:00
Chauncey 836bb3839f [Bugfix] Prevent out-of-bounds access in FlashInfer SM90 sparse MLA mixed batches (#56969) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-15 15:03:58 +00:00
Chauncey f0fbc98c48 [Frontend] Share max_num_queued_reqs across API server processes (#54746) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-15 14:50:26 +00:00
ChaunceyJared WenClaude Fable 5.1
 		8369affa54 [Feat] Add EPLB support for GLM-5.3-Flash (#55119) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Jared Wen <jaredwen@inferact.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-05 05:28:33 +00:00
Chauncey b2558f8da3 [Bugfix] Fix launch render hanging on shutdown (#54913) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-02 08:15:35 +00:00
Chauncey 339e16cbb6 [Bugfix] Support MCP SDK 2.x tool input schemas (#53870) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-09-01 11:02:39 -04:00
Chauncey 7d5769b2d9 [Perf][DSv4] Use native CUDA SwiGLU clamp kernel for Humming MoE (throughput +1.40%) (#53685) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-27 13:52:45 -07:00
Chauncey d21c5b50a1 [Perf][GLM5.2] Fuse sparse MLA Q concatenation with head padding (#53878) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-27 11:54:32 -04:00
Chauncey c6e19b3be2 [Bugfix][Structured Output] Avoid spurious FSM errors after speculative reasoning end (#53046) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-21 10:01:06 +08:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 83f591d7f6 [Perf][DSV4] Optimize global top-k index kernel with compile-time constants (#51967) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-16 23:24:14 +08:00
Chauncey 836aac92ff [Perf][DSV4] Optimize sparse top-k metadata kernels for higher prefill throughput (#52084) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-16 21:15:47 +08:00
Chauncey 84530eb235 [Bugfix][Multimodal] Keep Gemma 4 video frame counts on CPU (#52441) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-16 09:17:04 +00:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> ac2ae8798c [Frontend] Support count_reasoning_tokens in the Streaming Parser Engine (#45802) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-15 06:51:14 -07:00
ChaunceyandOr Ozeri c423998642 [KV Offload] Emit self-describing events for partial recurrent blocks (#51243) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-08-09 11:28:44 +03:00
ChaunceyandNick Hill 72c0d67657 [Feat] Support thinking_token_budget in Model Runner V2 (#46727) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-08-07 03:36:18 +00:00
Chauncey 22170354d8 [Feature] Parse request priority from HTTP header (#51089) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-05 21:10:29 -07:00
ChaunceyandOr Ozeri 62c5e21621 [KV Offloading] Support partial-tail prefix reuse with fine-grained prefix matching (#50507) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-08-05 22:31:50 +08:00
Chauncey 6c91de3689 [Bugfix][Parser] Forward model_config to nested reasoning parsers (#50642) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-08-01 13:07:34 +08:00
ChaunceyandAndreas Karatzas 03a2d03367 [Bugfix] Respect cgroup memory limits on all platforms (#49966) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 14:38:20 +08:00
Chauncey 94ed0bf4e0 [Bugfix][KV Offloading] Handle queued request aborts without allocated KV blocks (#49146) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-07-21 11:16:26 +08:00
ChaunceyandNick Hill ae6170f874 [P/D][Bugfix] Fix PD async KV load lookahead handling for MTP spec decode (#46694) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-07-09 10:01:22 +00:00
Chauncey 529af88842 [KV Offloading] Add free block iterator for CPU offload scheduling (#47849) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-07-09 06:59:54 +00:00
Chauncey 320ee285c9 [Model Runner V2][Perf] Warm up GLM-5.2 DSA indexer prefill metadata kernel (#47285) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-07-02 16:31:31 +00:00
Chauncey 697c34b97b [Bugfix] Fix beam search candidate indexing when logprobs count varies (#47126) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-07-01 07:07:06 +00:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 2bc20e8aba [Frontend] Add Streaming Parser Engine and new Kimi k2.5/k2.6/k2.7 Parser (#46610) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-30 07:53:17 +00:00
Chauncey 11a12305c0 [Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786) 2026-06-27 18:38:07 -07:00
Chaunceymergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Flora Feng
 		efb5acffd5 [Bugfix] fix: stream Mimimax m2 tool call string arguments (#46382) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-06-25 03:12:45 +00:00
Chauncey 84c2f9f0fb [Frontend] Fix Kimi K2 tool call IDs for required tool choice (#46344) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-06-24 19:59:40 +00:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 3ce5823762 [Refactor] Responses API parser state into conversation context (#46030) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-23 13:42:58 +08:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 6c379b9e54 [Frontend] Add Streaming Parser Engine and new GLM4.7/GLM5.1/GLM5.2 Parser (#45915) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-19 00:42:10 +08:00
Chauncey f00e163f35 [Frontend] Add Streaming Parser Engine and new MinimaxM2 Parser (#45701) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-06-16 13:38:17 -04:00
Chauncey 3b8fc3fe6d [Frontend] Support strict mode for tool calling with ResponsesAPI (#45396) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-06-12 10:59:59 -04:00
Chaunceycjackalmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		2043258dec [Frontend] Support strict mode for tool calling (#45003) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-12 07:51:48 +00:00
ChaunceykdcyberdudeBen Browning
 		27f1d34a23 [Frontend][Responses API] Move developer-to-system conversion into HF renderer (#43590) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: kdcyberdude <kdsingh.cyberdude@gmail.com>
Co-authored-by: Ben Browning <bbrownin@redhat.com>
 2026-06-03 14:52:24 +00:00
ChaunceyAleksandar YanakievAng Kah Min, Kelvin <syraxius@hotmail.com>
 		ed9a7526b6 [Anthropic] Support system role messages inside messages array (#44283) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Ang Kah Min, Kelvin <syraxius@hotmail.com>
 2026-06-02 18:13:54 +00:00
Chauncey 87f12e5c7c [Frontend]Responses API supports chat_template_kwargs (#43761) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-29 07:58:19 +00:00
Chauncey d692b89c2c [Feature] Add structured output and effort support to Anthropic Messages API (#42396) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-28 12:06:48 +00:00
Chauncey 920bf3ec84 [Bugifx] [Qwen3CoderTool] Restore supports_required_and_named for required tool_choice (#42292) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-12 02:09:56 +00:00
Chauncey 617239b70c [Frontend]Responses API supports chat_template_kwargs (#42272) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-11 11:59:39 +00:00
ChaunceyandQwertyJack 95582868ef [Bugfix] DeepSeekV32/v4: respect string='true|false' attribute andunwrap arguments/input wrapper (#41801) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
 2026-05-06 21:48:01 +00:00
Chauncey c7aa186d67 [Frontend] Supports resubmitting output items with missing fields in Responses API (#41355) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-05 22:21:33 -04:00
Chauncey ae3b4deb8a [Doc] Add Codex usage example (#41358) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-01 22:27:43 -07:00
Chaunceyandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> faab189554 [Feature]: IndexCache support for DSA models (#37735) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-04-29 15:15:35 -04:00
Chauncey 762022cafb [Bugfix] DSV32/V4 add missing type conversion for non-streaming tool calls (#41198) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-29 09:55:07 +00:00
Chauncey 3885d340a4 [Frontend]Responses API supports Tool/Function calling with streaming with named tool/function (#41110) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-29 09:11:27 +00:00
Chauncey 92879e12ba [CI] fix test_rotary_embedding_opcheck format error (#41202) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-29 00:32:37 -07:00
Chauncey 146f44b77d [Frontend]Responses API supports Tool/Function calling with streaming with required (#40700) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-27 19:36:58 -07:00
Chaunceysfeng33Windswithyou 1694599440@qq.com
 		c798593f0d [Bugfix] Fix the DSML token leakage in DSV4/3.2 (#40806) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Windswithyou 1694599440@qq.com
 2026-04-26 08:58:50 +08:00
Chauncey a2bd09c960 [Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to reasoning parsers (#40566) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-22 07:27:44 +00:00
Chauncey 18563f2072 [Misc] Reduce attention logging levels (#40086) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-21 02:09:25 +00:00
Chauncey 7a51b3e415 [Bugfix] Fix empty delta detection in Qwen3XMLToolParser streaming (#40090) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-17 13:34:55 +00:00
Chauncey db8d4a4a06 [BugFix][Graph] fix: handle empty sym_shape_indices in PiecewiseBackend. (#39395) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-15 09:28:09 -04:00
Chauncey d2130a47bb [Bugfix]: Fix MinimaxM2ToolParser missing tools parameter (#39683) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-14 11:16:39 +08:00
Chauncey ecbfbb8d61 [Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-10 01:36:26 +00:00
Chauncey cbe7d18096 [Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-04-01 09:56:45 -07:00
Chauncey ce884756f0 [Feature]: add presence_penalty and frequency_penalty fields to Responses API (#38613) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-31 08:45:57 +00:00
Chauncey 87f05d6880 [Revert] Remove DeepGEMM availability check in DeepseekV32IndexerMetadataBuilder (#38076) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-26 01:43:51 +00:00
Chauncey 09c3dc9186 [Revert] Remove CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#37968) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-25 06:19:37 +00:00
Chauncey a32783bb35 [Bugfix] Fix IndexError when accessing prev_tool_call_arr in OpenAIToolParser (#37958) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-25 12:06:21 +08:00
Chauncey 0523449c9c [Misc] Use logger.info_once for auto tool choice log message (#37661) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-20 10:40:36 +00:00
Chauncey 2f9f946b22 [P/D] AnthropicMessages add kv_transfer_params for PD disaggregation (#37535) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-19 16:41:20 +00:00
Chauncey b322b197f1 [Build] Bump python openai version (#32316) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-18 18:20:10 +08:00
Chauncey 132bfd45b6 [Bugfix][ResponsesAPI] Fix crash when tool_choice=required exceeds max_output_tokens (#37258) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-17 08:54:52 +00:00
Chauncey 6682c231fa [Bugfix] Add error handling for FINISHED_ERROR in OpenAIServing (#37148) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-16 16:27:47 +00:00
Chauncey 8d3f8f485e [Bugfix] fix Qwen3.5 tool calling bug (#36774) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-16 15:38:42 +08:00
Chauncey 5a71cdd76e [Bugfix] Fix crash when tool_choice=required exceeds max_tokens (#36841) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-12 03:28:45 -07:00
Chauncey 9fe404ed04 [Frontend] OpenAI Responses API supports Tool/Function calling with streaming (#29947) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-12 15:03:50 +08:00
Chauncey 9a87b0578f [Feat] Supports Anthropic Messages count_tokens API (#35588) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-03-02 09:48:54 +00:00
Chauncey 7e08c22b8c [Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-28 10:12:00 +00:00
Chauncey 57c86c0741 [Misc] Change logging level from info to debug for tool parser import (#35575) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-28 14:51:35 +08:00
Chauncey 06254d4cbb [CI] add trainer_send_weights for MockWeightTransferEngine (#35589) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-28 06:47:43 +00:00
Chauncey 7bec435130 [Bugfix] Fix the issue where tool calling does not work when using fast detokenization with dsv32 (#33964) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-06 09:23:44 -08:00
Chauncey 6abb0454ad [Perf] Optimize the performance of structured output + reasoning (#33557) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-05 15:45:29 +08:00
Chauncey a7be77beef [Bugfix] fix DeepSeek R1 with CUTLASS MLA Broken on B200 (#33637) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-05 01:28:36 +00:00
Chauncey f67ee8b859 [Perf] Optimize chat completion streaming performance (#33782) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-02-04 12:30:36 +00:00
ChaunceyandKoushik Dutta bf001da4bf [Bugfix] Interleaved thinking keeps compatibility with reasoning_content (#33635) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Koushik Dutta <koushd@gmail.com>
 2026-02-03 06:46:05 +00:00
Chauncey 8e5e40daf4 [Misc] Provide a DeepSeek ReasoningParser with thinking enabled by default (#33221) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-28 21:16:53 +08:00
Chauncey a2393ed496 [CI] Fix AssertionError: MCP tool call not found in output_messages (#33093) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-26 15:19:57 +00:00
Chauncey 9ef3b718d9 [Bugfix] Fix Can't instantiate abstract class DeepseekV32IndexerBackend (#33052) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-26 06:44:02 -08:00
Chauncey 841d53aaa8 [Frontend] add prompt_cache_key for openresponses (#32824) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-22 11:34:14 +00:00
Chauncey c4e5bdf61b [Bugfix] Fix the fp8_mqa_logits dim mismatch (#32652) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-20 18:48:07 +08:00
Chauncey 707b44cc28 [Refactor] [11/N] to simplify the mcp architecture (#32396) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-15 18:49:31 +08:00
Chauncey 4c1c501a7e [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-15 07:41:34 +00:00
Chauncey 00e6402d56 [Frontend] track responsesAPI server_load (#32323) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-14 12:00:37 +00:00
Chauncey 769d0629e1 [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-14 10:20:58 +00:00
Chauncey 9312a6c03a [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-14 07:26:24 +00:00
Chauncey 4f02cb2eac [Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-13 15:37:34 +00:00
Chauncey fefce49807 [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-13 13:01:39 +00:00
Chauncey eaba8ece77 [Bugfix]: Fix Step3ReasoningParser missing is_reasoning_end_streaming (#31969) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-08 15:28:13 +00:00
Chauncey 1da3a5441a [Docs]: update claude code url (#31971) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-08 14:04:55 +00:00
Chauncey 0202971a48 [Frontend] Support GLM-4.5 / GLM-4.7 with enable_thinking: false (#31788) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-01-06 13:53:21 +00:00
Chauncey 48d5ca4e8b [CI] fix test_chat_truncation_content_not_null test (#31488) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-12-29 12:47:08 +00:00