[Model] Streamline EmbeddingGemma 2 config resolution and harmonize Triton prefill attention (#60289)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com> Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
This commit is contained in:
co-authored by
Luciano Martins
Matthew Bonanni
parent
947dd62c07
commit
b803edbc9f
@@ -1139,7 +1139,7 @@ def get_sentence_transformer_tokenizer_config(
|
||||
|
||||
logger.info("Found sentence-transformers tokenize configuration.")
|
||||
|
||||
if all(k in encoder_dict for k in ("max_seq_length", "do_lower_case")):
|
||||
if "max_seq_length" in encoder_dict:
|
||||
return encoder_dict
|
||||
return None
|
||||
|
||||
|
||||
Reference in New Issue
Block a user