[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)

Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
This commit is contained in:
Tahsin Tunan
2026-06-30 01:45:59 +00:00
committed by GitHub
co-authored by Bugen Zhao mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent 43916891b2
commit b8cb75b149
16 changed files with 1942 additions and 125 deletions
+4 -2
View File
@@ -378,9 +378,11 @@ class RustFrontendProcessManager:
# The Rust `frontend` subcommand parses --args-json via serde_json,
# which bypasses clap and therefore ignores any `#[arg(env = ...)]`
# declarations on SharedRuntimeArgs fields. Forward the env-driven
# ready timeout explicitly so VLLM_ENGINE_READY_TIMEOUT_S behaves the
# same on both Python and Rust frontends.
# values explicitly so VLLM_ENGINE_READY_TIMEOUT_S and
# VLLM_HTTP_TIMEOUT_KEEP_ALIVE behave the same on both Python and Rust
# frontends.
args_dict["engine_ready_timeout_secs"] = envs.VLLM_ENGINE_READY_TIMEOUT_S
args_dict["http_timeout_keep_alive"] = envs.VLLM_HTTP_TIMEOUT_KEEP_ALIVE
args_json = json.dumps(args_dict, sort_keys=True)
cmd.extend(["--args-json", args_json])