[Misc] Aligning tokwise pooler heads for consistency (#43041)

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
This commit is contained in:
Taneem Ibrahim
2026-05-19 06:16:42 +00:00
committed by GitHub
parent f1e3f0e6d6
commit 4a4fdabe28
4 changed files with 9 additions and 4 deletions
@@ -78,7 +78,8 @@ class TokenEmbeddingPoolerHead(TokenPoolerHead):
# embeddings shape: [n_tokens, embedding_size]
# for matryoshka representation
embeddings = embeddings[..., : pooling_param.dimensions]
if pooling_param.dimensions is not None:
embeddings = embeddings[..., : pooling_param.dimensions]
# for normalize
if self.activation is not None and pooling_param.use_activation: