[Model] Support Gemma2 embedding model (#9004)

This commit is contained in:
Xin Yang
2024-10-05 06:57:05 +00:00
committed by GitHub
parent 53b3a33027
commit 15986f598c
5 changed files with 99 additions and 3 deletions
+1
View File
@@ -277,6 +277,7 @@ class HfRunner:
SentenceTransformer(
model_name,
device="cpu",
trust_remote_code=True,
).to(dtype=torch_dtype))
else:
model_kwargs = model_kwargs if model_kwargs is not None else {}