[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)
Co-authored-by: Bugen Zhao <i@bugenzhao.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com> Signed-off-by: Bugen Zhao <i@bugenzhao.com>
This commit is contained in:
co-authored by
Bugen Zhao
mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent
43916891b2
commit
b8cb75b149
+4
-2
@@ -378,9 +378,11 @@ class RustFrontendProcessManager:
|
||||
# The Rust `frontend` subcommand parses --args-json via serde_json,
|
||||
# which bypasses clap and therefore ignores any `#[arg(env = ...)]`
|
||||
# declarations on SharedRuntimeArgs fields. Forward the env-driven
|
||||
# ready timeout explicitly so VLLM_ENGINE_READY_TIMEOUT_S behaves the
|
||||
# same on both Python and Rust frontends.
|
||||
# values explicitly so VLLM_ENGINE_READY_TIMEOUT_S and
|
||||
# VLLM_HTTP_TIMEOUT_KEEP_ALIVE behave the same on both Python and Rust
|
||||
# frontends.
|
||||
args_dict["engine_ready_timeout_secs"] = envs.VLLM_ENGINE_READY_TIMEOUT_S
|
||||
args_dict["http_timeout_keep_alive"] = envs.VLLM_HTTP_TIMEOUT_KEEP_ALIVE
|
||||
args_json = json.dumps(args_dict, sort_keys=True)
|
||||
cmd.extend(["--args-json", args_json])
|
||||
|
||||
|
||||
Reference in New Issue
Block a user