[Rust Frontend] Simplify data-parallel size ownership (#52575)
Signed-off-by: Bugen Zhao <i@bugenzhao.com> Co-authored-by: Nick Hill <nickhill123@gmail.com>
This commit is contained in:
@@ -58,7 +58,6 @@ async fn main() -> Result<()> {
|
||||
local_input_address: None,
|
||||
local_output_address: None,
|
||||
},
|
||||
data_parallel_size: args.engine_count,
|
||||
coordinator_mode: CoordinatorMode::MaybeInProc,
|
||||
model: args.model,
|
||||
served_model_name: vec![],
|
||||
|
||||
Reference in New Issue
Block a user