[Qwen3.5] Pass quant_config and prefix to embed_tokens in Qwen3_5Model
Apply the qwen3_5_quantized_embedding patch: construct the embedding through the model's quant config so quantized (e.g. fp8/int8) embeddings are supported, and give it a stable prefix for weight loading. Co-Authored-By: Hinata <hinata@idihore.id> Signed-off-by: MOVZX <movzx@yahoo.com>
This commit is contained in:
@@ -247,6 +247,8 @@ class Qwen3_5Model(Qwen3NextModel):
|
|||||||
self.embed_tokens = VocabParallelEmbedding(
|
self.embed_tokens = VocabParallelEmbedding(
|
||||||
self.vocab_size,
|
self.vocab_size,
|
||||||
config.hidden_size,
|
config.hidden_size,
|
||||||
|
quant_config=self.quant_config,
|
||||||
|
prefix=f"{prefix}.embed_tokens",
|
||||||
)
|
)
|
||||||
|
|
||||||
def get_layer(prefix: str):
|
def get_layer(prefix: str):
|
||||||
|
|||||||
Reference in New Issue
Block a user