[BugFix] Only probe quantization overrides that exist in the tree
The SM86 cut removed the inc and deepseek_v4_fp8 loaders but ModelConfig still probed them, crashing compressed-tensors checkpoints with "Invalid quantization method: inc". Filter the override probe list to the supported methods. Co-authored-by: Hinata
This commit is contained in:
@@ -1392,7 +1392,9 @@ class ModelConfig:
|
||||
# Any custom overrides will be in quantization_methods so we place
|
||||
# them at the start of the list so custom overrides have preference
|
||||
# over the built-in ones.
|
||||
quantization_methods = quantization_methods + overrides
|
||||
quantization_methods = quantization_methods + [
|
||||
o for o in overrides if o in supported_quantization
|
||||
]
|
||||
|
||||
# Detect which checkpoint is it
|
||||
for name in quantization_methods:
|
||||
|
||||
Reference in New Issue
Block a user