[Pooling] Support prompt embeddings in MRV2 decoder pooling (#56639)

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
This commit is contained in:
Taneem Ibrahim
2026-09-13 05:49:45 +00:00
committed by GitHub
parent 93e051e290
commit 0cf266a469
2 changed files with 2 additions and 2 deletions
-1
View File
@@ -1128,7 +1128,6 @@ class GPUModelRunner(LoRAModelRunnerMixin):
if self.pooling_runner is not None:
assert new_req_data.pooling_params is not None
assert new_req_data.prompt_token_ids is not None
self.pooling_runner.add_request(
req_id,
req_index,