[Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166)

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>
This commit is contained in:
Yifan Qiao
2025-12-26 18:25:46 -08:00
committed by GitHub
co-authored by KuntaiDu
parent 5326c89803
commit 52bf066516
8 changed files with 362 additions and 111 deletions
+1 -1
View File
@@ -624,7 +624,7 @@ class Worker(WorkerBase):
output = self.model_runner.execute_model(
scheduler_output, intermediate_tensors
)
if isinstance(output, (ModelRunnerOutput, NoneType)):
if isinstance(output, ModelRunnerOutput | NoneType):
return output
assert isinstance(output, IntermediateTensors)