[Rust Frontend][gRPC] Add multimodal image inference (#50368)
Co-authored-by: Bugen Zhao <i@bugenzhao.com> Signed-off-by: Connor Carpenter <connorc@nvidia.com> Signed-off-by: Bugen Zhao <i@bugenzhao.com>
This commit is contained in:
co-authored by
Bugen Zhao
parent
0b1c151cbc
commit
e98a8774cb
@@ -154,7 +154,7 @@ pub struct SharedRuntimeArgs {
|
||||
#[arg(long, value_parser = clap::value_parser!(i32).range(-1..), allow_negative_numbers = true)]
|
||||
#[serde(default)]
|
||||
pub max_logprobs: Option<i32>,
|
||||
/// TCP port for the gRPC Generate service. When not set, no gRPC server is
|
||||
/// TCP port for the gRPC Inference service. When not set, no gRPC server is
|
||||
/// started.
|
||||
#[arg(long)]
|
||||
#[serde(default)]
|
||||
|
||||
Reference in New Issue
Block a user