iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,297 Commits 3 Branches 0 Tags
main
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Flora FengandChauncey 80dd705c1d [Frontend] Make finish_reason and Responses item status truthful (#59324) 
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2026-10-15 10:12:02 +01:00
Flora Feng 785b990116 [Distributed] Enable custom all-reduce under VLLM_BATCH_INVARIANT (#58623) 
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-10-02 02:25:48 +00:00
Flora Feng a5105dba05 [Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-10-01 22:18:37 +00:00
Flora FengandClaude Fable 5.1 a3af78384a [Agents] Add API compatibility checking skill (#58003) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-30 04:59:48 +00:00
Flora Feng 7ca31ef599 [Bugfix][Responses API] Build streamed final response from streamed items (#59307) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-30 00:16:05 +00:00
Flora Feng 797505747f [Bugfix][Frontend] Honor parallel_tool_calls=false in the Responses API (#59298) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-29 22:36:11 +00:00
Flora Feng 6f65fde419 [Bugfix][Frontend] Apply Harmony adjust_request in batched chat completions (#58958) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-28 04:12:04 +00:00
Flora Feng 027b6f3a22 [Bugfix][Frontend] Use a fresh parser per choice in non-streaming chat completions (#58939) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-28 02:01:35 +00:00
Flora Feng 4d07e90653 [Bugfix][Frontend] Sample batched chat completions from the adjusted requests (#58929) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-28 01:46:55 +00:00
Flora Feng 3184226984 [Bugfix][Frontend] Count Responses reasoning tokens per tool round (#58927) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-28 00:34:38 +00:00
Flora Feng e0705731be [Refactor] Remove unused interface methods (#57194) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-16 21:00:48 +00:00
Flora Feng 3bb7826214 [Agent] Add agent instructions for parser directories (#56883) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-16 06:55:26 -04:00
Flora Feng 24bfbd5d4d [Refactor] Derive is_reasoning_end from the engine grammar (#56200) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-15 10:07:58 +00:00
Flora Feng 9e25706560 [Bugfix] Tolerate misspelled DSML tool_calls wrapper (#56141) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-10 15:04:29 +08:00
Flora Feng d98c8c030b [Bugfix] Parse DSML tool calls when the model omits the tool_calls wrapper (#55954) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-08 17:38:04 -07:00
Flora FengandWentao Ye 0a742da274 [Perf] Eliminate full-history reasoning scans for structured outputs (#55223) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-08 14:07:22 -07:00
Flora FengandWentao Ye 29f46ac475 [Perf] Eliminate full-history reasoning scans for structured outputs (#55223) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-08 14:07:16 -07:00
Flora Feng 300f688321 [Bugfix] Implicitly close DeepSeek DSML parameters (#54838) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-02 14:13:36 +08:00
Flora Feng 45aed9b0cd [CI] Broaden tool-calling issue auto-labeling (#54650) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-09-01 10:07:21 +08:00
Flora Feng 89df6fcb80 [CI] Broaden structured-output issue auto-labeling (#54645) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-08-31 23:51:55 +00:00
Flora Feng 46638857fd [Bugfix][Structured Output] Preserve reasoning adapters for shared parser engines (#52830) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-08-26 00:37:36 -04:00
Flora Feng 12f64b39d2 [Bugfix][Structured Output] Stop XGrammar token batches at termination (#52805) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-08-18 21:21:43 +00:00
Flora FengandWentao Ye 8bcc916a98 [Bugfix] Fix DeepSeek V4/3.2 tokenizer vocab size overcount crashing guided decoding (#51727) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-10 23:00:08 +00:00
Flora Feng 3f142bd85e [Bugfix] Align deepseek v4 parser thinking default with tokenizer (#51296) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-08-10 19:30:30 +00:00
Flora Feng 05f0a80016 [Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#49227) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-08-10 14:29:20 -04:00
Flora Feng fca252d59e [CI][Bugfix] Reduce max_model_len in OOT embedding test to fix KV-cache OOM on small GPUs (#49351) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-07-21 15:00:06 -04:00
Flora Feng 96eb8ddc41 [CI] Re-enable skipped glm and seedoss parser tests (#46671) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-25 13:11:41 -04:00
Flora Feng 560fb8b867 [Cohere] Remove dead prepare_structured_tag override in Cohere parser (#46099) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-19 01:02:11 +00:00
Flora Feng 475a6ad18a [Misc] Update Mergify tool-calling label (#45853) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-16 19:08:00 +00:00
Flora Feng cd9078fe59 [Frontend] Skip structural tags for auto tool_choice without strict mode (#45600) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-15 19:55:31 +00:00
Flora Feng 0d80979644 [Chore] Consolidate reasoning/tool parser attributes into unified Parser in chat serving (#45548) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-15 11:16:45 -04:00
Flora Feng e3e3cd5458 [Bugfix][CI] Update Dockerfile dependency graph PNG (#45602) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-15 10:35:24 +08:00
Flora Feng 6e4a547176 [Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext (#45431) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-12 16:15:41 -04:00
Flora Feng 3a04061701 [Refactor][Parser] Unify Response API to use parser.parse() like Chat Completion API (#45190) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-11 04:37:51 +00:00
Flora Feng b038a2f73b [CI][Bugfix] Update Dockerfile dependency graph PNG (#45209) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-10 19:40:25 -07:00
Flora Feng 6aec99f030 [Refactor] Remove dead states from chat completion serving (#45081) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-09 22:20:15 -07:00
Flora Feng d82ac00923 [Refactor][Mistral] Extract parsing logic into MistralParser (#44596) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-10 00:12:23 +00:00
Flora Feng e3e132d2dd [Refactor] Suppress SyntaxWarning from ast.literal_eval in tool parsers (#44346) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-03 10:42:19 -04:00
Flora Feng 209709a8c1 [Bugfix] Fix unstreamed tool call args dropped in Responses API streaming (#44348) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-03 03:19:08 -07:00
Flora Feng e67063826b [CI] Add missing vllm/parser/ CI trigger and fix test_parse.py (#44352) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-02 21:05:19 -07:00
Flora Feng 478b49ddec [Refactor] Remove dead code from parser infrastructure (#44279) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-02 12:08:27 -04:00
Flora Feng 68dafcca75 [Refactor] Unify reasoning + tool-call parsing behind Parser.parse() (#44267) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-02 15:11:42 +08:00
Flora Feng 9affc17a05 [Refactor] Move unstreamed tool-arg flush from serving layer to parser (#44017) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-02 10:37:43 +08:00
Flora Feng 1a096d8208 [Refactor] Remove dead current_tool_name_sent assignments from tool parsers (#43997) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-29 21:45:15 -04:00
Flora Feng 8c6daf6e2f [CI] Remove duplicate Harmony test coverage (#44023) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-29 22:52:46 +00:00
Flora Feng 6de08e8b46 [CI] Remove redundant test_chat_with_tool_reasoning.py (#44011) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-29 19:23:56 +00:00
Flora Feng b32fe416ea [Bugfix] Fix reasoning dropped on streaming boundary deltas (#42691) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-23 16:18:30 -07:00
Flora Feng 6441cf4a44 [Refactor] Use shared coerce_to_schema_type in Seed-OSS tool parser (#43140) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-20 21:24:06 -07:00
Flora Feng 2a43b407c5 [Bugfix][CI] Add missing import of pad_nvfp4_activation_for_cutlass in flashinfer (#43237) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-20 11:59:12 -07:00
Flora Feng a10d69116c [Bugfix] Use shared coerce_to_schema_type in DeepSeekV32 tool parser (#43019) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-20 10:21:00 -04:00
Flora Feng 42b4f1fdf7 [Refactor] Extract extract_types_from_schema utility from Minimax M2 tool parser (#43025) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-19 11:21:12 -04:00
Flora Feng 57fef4e0bf [Refactor] Extract shared coerce_to_schema_type utility from Minimax M2 tool parser (#43006) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-18 17:55:39 -04:00
Flora Feng 1087676a90 [Refactor] Use shared utils in hermes tool parser (#42570) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-13 20:35:45 -04:00
Flora Feng 639cbfd274 [CI] Add tests/parser to CI coverage (#41877) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-11 19:08:54 +00:00
Flora Feng 8eb401134e [Refactor] Consolidate required/named tool_choice streaming into DelegatingParser (#41876) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-07 09:50:59 -07:00
Flora Feng f3f8efa73a [CI] Enable gemma4 parser test on CI (#41857) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-06 20:25:34 +00:00
Flora Fengandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8317cedc77 [Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-04-22 22:46:10 -07:00
Flora Feng 03ce1c6ed9 [Bugfix] Kimi-K2 tool parser streaming - fix token leakage, argument truncation, and content dropping (#38579) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-19 01:30:27 -07:00
Flora Feng b16fda62b7 [Misc] Add @sfeng33 to CODEOWNERS (#40048) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-16 12:25:29 -07:00
Flora Feng db8a6d66bf [Refactor][Parser] Migrate chat completion auto-tool/reasoning/plain streaming to parse_delta (#39446) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-14 04:39:45 +00:00
Flora Feng 14cb86c187 [Refactor][Parser] Simplify parse_delta (#39728) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-13 21:02:13 +00:00
Flora Feng 0e39202ca9 [Bugfix] Fix GLM tool parser streaming with MTP or stream interval (#39253) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-13 05:10:30 +00:00
Flora Feng 13151a4df4 [Bugfix] Fix Gemma4 streaming tool call corruption for split boolean/number values (#39114) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-08 16:46:27 +00:00
Flora Feng 927975ead8 [Parser] Migrate response api streaming to unified parser (#38755) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Andrew Xia <axia@meta.com>
 2026-04-08 10:09:00 +08:00
Flora Feng 9ea7d670d8 [Bugfix] Fix Qwen3 tool parser for Responses API tools (#38848) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-08 10:08:51 +08:00
Flora Feng 5af684c319 [CI] Add reasoning parser tests to CI (#37025) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-08 00:57:36 +00:00
Flora Feng 0102bd2f4c [Parser] Pass request.tools to tool parser (#38860) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-08 01:36:21 +08:00
Flora Feng d53cb9cb8e [Tool Parser][2/3] Use self.tools instead of request.tools in tool parsers (#38189) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-31 13:41:36 +08:00
Flora Feng 3e802e8786 [Mypy] Fix adjust_request typing (#38264) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-31 04:21:18 +00:00
Flora Feng 29e48707e8 [Refactor] Consolidate Tool type alias in tool_parsers/utils.py (#38265) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-31 00:55:51 +00:00
Flora Feng aee4c14689 [Bugfix] Fix Hermes tool parser when stream interval > 1 (#38168) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-27 14:42:26 +08:00
Flora Feng e2db2b4234 [Tool Parser][1/3] Pass tools to ToolParser constructor (#38029) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-26 10:29:06 +08:00
Flora Feng 2e67fa756d Fix tool_parser_cls type annotation from Callable to type[ToolParser] (#37957) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-23 22:58:27 -07:00
Flora Feng b4c1aef21c [Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:50:34 -07:00
Flora Feng 6050b93bed [Refactor] Move serve entrypoint tests under tests/entrypoints/serve/ (#37595) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:10:47 -07:00
Flora Feng e2d1c8b5e8 [Refactor] Relocate entrypoint tests to match serving code structure (#37593) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 05:31:23 +00:00
Flora Feng 9040151fe1 [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 11:31:43 +08:00
Flora Feng e5a77a5015 [CI] Update mergify tool-calling label paths (#37478) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:22:23 +00:00
Flora Feng be12afd284 [Bugfix] Fix Deepseekv32 tool parser when stream interval > 1 (#36056) 2026-03-19 19:51:25 -04:00
Flora Feng b21d384304 [Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-19 07:19:36 +00:00
Flora Feng 3e3d320c1b [Refactor] Relocate responses API tests (#37241) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-17 05:14:52 +00:00
Flora Feng 384dc7f77b [Refactor] Relocate completion and chat completion tests (#37125) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-17 11:31:23 +08:00
Flora Feng f04d5226f8 [CI] Fix flaky tool_use chat completion tests with deterministic seed (#37027) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-17 03:24:34 +00:00
Flora Fengandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> dfa8852db2 [Refactor] Consolidate GPT-OSS reasoning parser tests (#36915) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-16 15:53:07 -04:00
Flora Feng bcfdadb1bc [Refactor] Relocate chat completion and anthropic tests (#36919) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-14 12:16:16 +08:00
Flora Feng 8647c6cf51 [Bugfix] Fix minimax_m2 tool parser when stream interval > 1 (#35895) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-12 10:25:14 +08:00
Flora FengandRobert Shaw 741ecf0630 [CI] Add bfcl tool call correctness eval (#36560) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-03-11 12:27:36 -04:00
Flora FengandSigned-off-by: yewentao256 <zhyanwentao@126.com> d5080aeaa4 [Refactor] Remove deadcode in Responses API serving (#36726) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-03-11 07:11:41 +00:00
Flora Feng 186ea22efe [Misc][Harmony] Move Responses API only harmony utils to responses/harmony.py (#35339) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-02-26 14:35:16 +08:00
Flora Feng ec1d30c0f6 [Responses] Decouple SSE event helpers from Harmony context (#35148) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-02-24 20:05:25 -08:00
Flora FengandCyrus Leung ed31a020ee [Refactor] Extract Harmony streaming SSE event builders into streaming_events.py (#34909) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-20 06:20:46 -08:00
Flora FengFlora FengNicolò Lucchesi
 		8d9babd4de Fix empty tool_call_id in Anthropic messages API tool result conversion (#34745) 
Signed-off-by: <>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Flora Feng <sfeng33@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
 2026-02-18 14:31:59 -08:00
Flora Feng 1e4a084c8e [CI] Fix flaky test_parsable_context (#34717) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-02-17 18:42:52 +00:00
Flora Feng 0377802c20 [Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-09-12 21:42:23 +08:00
Flora Feng 77f62613f9 Consolidate rendering parameters into RenderConfig dataclass (#24543) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-09-10 08:44:47 +00:00
Flora Feng 15cb047e25 Extend renderer with embedding support and integrate completion endpoint (#24405) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-09-10 01:46:46 +08:00
Flora Feng 0661cb9df3 Add renderer-based prompt processing for embedding and classification endpoints (#24356) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-09-07 08:26:48 +00:00
Flora Feng 712b273f65 [Refactor] Introduce basic Renderer for completion-style request (#24010) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-09-04 05:21:12 +00:00
Flora Feng 69f46359dd [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-08-29 18:36:57 +08:00
Flora Feng 53415653ff [P/D][Nixl] Make kv cache register compatible with hybrid memory allocator (#23079) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-08-21 22:30:48 -07:00