[Qwen3.5] Pass quant_config and prefix to embed_tokens in Qwen3_5Model

Apply the qwen3_5_quantized_embedding patch: construct the embedding
through the model's quant config so quantized (e.g. fp8/int8)
embeddings are supported, and give it a stable prefix for weight
loading.

Co-Authored-By: Hinata <hinata@idihore.id>
Signed-off-by: MOVZX <movzx@yahoo.com>
This commit is contained in:
2026-09-27 09:53:21 +07:00
co-authored by Hinata
parent 77871126f9
commit 758cc4f9e1
+2
View File
@@ -247,6 +247,8 @@ class Qwen3_5Model(Qwen3NextModel):
self.embed_tokens = VocabParallelEmbedding(
self.vocab_size,
config.hidden_size,
quant_config=self.quant_config,
prefix=f"{prefix}.embed_tokens",
)
def get_layer(prefix: str):