[Rust Frontend][gRPC] Add multimodal image inference (#50368)

Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
This commit is contained in:
Connor Carpenter
2026-08-04 09:34:31 +00:00
committed by GitHub
co-authored by Bugen Zhao
parent 0b1c151cbc
commit e98a8774cb
12 changed files with 553 additions and 69 deletions
+1 -1
View File
@@ -154,7 +154,7 @@ pub struct SharedRuntimeArgs {
#[arg(long, value_parser = clap::value_parser!(i32).range(-1..), allow_negative_numbers = true)]
#[serde(default)]
pub max_logprobs: Option<i32>,
/// TCP port for the gRPC Generate service. When not set, no gRPC server is
/// TCP port for the gRPC Inference service. When not set, no gRPC server is
/// started.
#[arg(long)]
#[serde(default)]