28 Commits
Author SHA1 Message Date
467b024f21 [Rust Frontend] Report vllm-proto schema version in ServerInfo (#61533)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
2026-10-14 16:21:48 +08:00
51ef239768 [Rust Frontend] Carry reasoning controls over gRPC (#59836)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 11:11:19 +08:00
Alec 29ae81fe83 [Rust Frontend] Preserve explicit zero sampling values in gRPC requests (#60115)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
2026-10-08 07:27:47 +00:00
Alec 14e3902d51 [Frontend][Rust] Add gRPC forbidden token sequences and cache usage (#59837)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
2026-10-07 07:46:44 -07:00
f28a508162 [Feature][Rust Frontend] Add Shutdown control RPC (#59316)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-30 12:49:25 +00:00
Karen Chung 986e217158 [Feature] Add first-class KV hints request envelope for programmatic KV management (#53423)
Signed-off-by: Karen Chung <karenc@nvidia.com>
2026-09-21 09:56:11 -07:00
Biswa PandaandBugen Zhao 95d723700b [Rust Frontend] Return sampling masks over gRPC (#56777)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
2026-09-18 08:26:17 +00:00
Alec d2a2a82954 [Rust Frontend] Bump vllm-proto to 0.3.0 (#57233)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
2026-09-17 03:41:55 +00:00
AlecandCodex 9639cbde04 [Rust Frontend] Expose local DP size in gRPC Control metadata (#57116)
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-16 11:28:08 -07:00
f37c550bf6 [Feature][Frontend] Expose effective attention block size for DCP (#56538)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-16 08:29:43 +00:00
fdfcbbcac7 [CI/Build][Rust Frontend] Retire Buf schema publishing (#57046)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
2026-09-16 03:02:25 +00:00
Nicolò LucchesiandCodex 1713a09491 [Rust Frontend] Forward per-request watermarking controls (#56338)
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
2026-09-14 23:17:02 +08:00
31759ccb6d [Rust Frontend][Multimodal] Accept preprocessed multimodal gRPC features (#55047)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-12 02:29:49 +00:00
JulienDarveOpenAI CodexBugen Zhaomergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
69db1c26b4 [CI/Build][Rust Frontend] Publish vllm-proto on crates.io (#56365)
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Julien Darve <jdarve@NVIDIA.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-11 16:28:52 +08:00
Connor CarpenterBugen Zhaomergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
1f9444a34f [Rust Frontend][gRPC] Add LoRA lifecycle control (#52840)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-08-25 04:13:19 +00:00
Biswa Panda 9dba2c9b37 [Rust Frontend][RL]: report engine world size over gRPC (#53204)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
2026-08-23 02:31:23 +00:00
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> f08a95f8d8 [Rust Frontend][gRPC] Advertise LoRA capabilities (#52031)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-17 13:27:56 -07:00
Biswa Panda 42156466db [Rust Frontend][gRPC] Preserve skip_special_tokens decoding option (#52384)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
2026-08-15 08:54:58 +00:00
Connor CarpenterandNick Hill f473870ecf [Rust Frontend][gRPC] Add RL lifecycle control (#51316)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-08-14 11:32:39 -07:00
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 635dd6aae6 [Build][gRPC] Publish protobuf schemas to Buf (#51276)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-08-10 13:34:39 -07:00
Connor CarpenterandBugen Zhao e98a8774cb [Rust Frontend][gRPC] Add multimodal image inference (#50368)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-08-04 09:34:31 +00:00
Karen Chung f57123aa2d feat(frontend): session id plumbing into requests (#48048)
Signed-off-by: Karen Chung <karenc@nvidia.com>
2026-08-03 22:18:58 +00:00
Connor CarpenterandNick Hill 48fc2e2797 feat(grpc): add KV event source discovery (#50033)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-07-29 13:46:40 -07:00
Connor CarpenterandNick Hill e3c2fc3b3c [Rust Frontend][gRPC] Add server and model discovery (#49491)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
2026-07-27 09:53:27 -07:00
Connor CarpenterandOpenAI Codex c79ad3ae21 [Rust Frontend][gRPC] Add abort control RPC (#49255)
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
2026-07-22 11:31:01 +00:00
Bugen Zhao 487dfb3418 [CI] Add SPDX license header to Rust/Protobuf sources (#48472)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-07-13 10:22:47 +01:00
omerpaz95andOr Ozeri 8df14cfc8c [EC Connector] Add EC Transfer Params (#42433)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
2026-07-12 14:35:33 +03:00
39910f2b25 [Rust Frontend] Move code from vllm-frontend-rs (#43283)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Eric Curtin <eric.curtin@docker.com>
Signed-off-by: Dev-X25874 <283057883+Dev-X25874@users.noreply.github.com>
Signed-off-by: Will.hou <1205157517@qq.com>
Signed-off-by: Will.hou <willamhou@ceresman.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Eric Curtin <eric.curtin@docker.com>
Co-authored-by: Dev-X25874 <283057883+Dev-X25874@users.noreply.github.com>
Co-authored-by: Will.hou <1205157517@qq.com>
Co-authored-by: Will.hou <willamhou@ceresman.com>

Please see https://github.com/Inferact/vllm-frontend-rs for full original commit history.
2026-05-21 17:21:48 -07:00