Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
635dd6aae6
Signed-off-by: Connor Carpenter <connorc@nvidia.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
9 lines
440 B
Markdown
9 lines
440 B
Markdown
# vLLM gRPC API
|
|
|
|
Protocol definitions for the optional gRPC server exposed by the vLLM Rust frontend.
|
|
|
|
- `Inference` provides unary and streaming generation.
|
|
- `Control` provides discovery and request control.
|
|
|
|
The `nightly` label is updated daily from vLLM's `main` branch. The `main` label tracks the latest vLLM release, and version labels match tags such as `v0.27.0`. Pin a Buf commit or generated SDK version for reproducible builds.
|