[Rust Frontend][RL]: report engine world size over gRPC (#53204)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
This commit is contained in:
@@ -61,7 +61,8 @@ pub struct EngineCoreReadyResponse {
|
||||
pub dtype: ModelDtype,
|
||||
/// Python vLLM version reported by the engine process.
|
||||
pub vllm_version: String,
|
||||
/// World size (TP * PP) from the parallel config.
|
||||
/// Per-DP-engine world size (TP * PP * PCP) from the parallel config.
|
||||
/// Deployment-wide world size also multiplies by `data_parallel_size`.
|
||||
pub world_size: u64,
|
||||
/// Data-parallel size from this EngineCore's effective parallel config.
|
||||
/// Dense independent-DP ranks are reconfigured to report `1`; the client
|
||||
|
||||
Reference in New Issue
Block a user