[Bugfix] resolve Qwen3-VL GPTQModel quantized model loading failure (#28663)
Signed-off-by: GuanH <guansdrailib@gmail.com> Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
This commit is contained in:
@@ -117,9 +117,10 @@ class AutoWeightsLoader:
|
||||
environment variable `VLLM_LOGGING_LEVEL=DEBUG`.
|
||||
"""
|
||||
|
||||
# Models trained using early version ColossalAI
|
||||
# may include these tensors in checkpoint. Skip them.
|
||||
# Models trained using early version ColossalAI or quantized by
|
||||
# GPTQModel may include these tensors in checkpoint. Skip them.
|
||||
ROTARY_EMBEDS_UNUSED_WEIGHTS = [
|
||||
"rotary_pos_emb.inv_freq",
|
||||
"rotary_emb.inv_freq",
|
||||
"rotary_emb.cos_cached",
|
||||
"rotary_emb.sin_cached",
|
||||
|
||||
Reference in New Issue
Block a user