[Bugfix] Sync block_size from EngineCore to frontend for hybrid Mamba… (#42967)
Signed-off-by: Amit Gruner <agruner@crusoe.ai> Co-authored-by: Amit Gruner <agruner@crusoe.ai> Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
This commit is contained in:
co-authored by
Amit Gruner
Jiangyun Zhu
parent
b623f7ea95
commit
654bd2bca4
@@ -74,6 +74,7 @@ class EngineCoreReadyResponse:
|
||||
|
||||
max_model_len: int
|
||||
num_gpu_blocks: int
|
||||
block_size: int
|
||||
dp_stats_address: str | None
|
||||
dtype: str
|
||||
vllm_version: str
|
||||
|
||||
Reference in New Issue
Block a user