[Rust Frontend][gRPC] Advertise LoRA capabilities (#52031)

Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
This commit is contained in:
Connor Carpenter
2026-08-17 13:27:56 -07:00
committed by GitHub
co-authored by mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent d1e3eee6fb
commit f08a95f8d8
10 changed files with 53 additions and 0 deletions
+2
View File
@@ -88,6 +88,8 @@ class EngineCoreReadyResponse:
max_num_seqs: int
max_num_batched_tokens: int
instance_id: str
supports_lora: bool
max_loras: int
# KV cache capacity (None for encoder-only/attention-free models).
kv_cache_size_tokens: int | None = None
kv_cache_max_concurrency: float | None = None