[Bugfix][Quantization][MoE] Normalise an unset group_size on the compressed-tensors WNA16 MoE path (#53163)

Signed-off-by: Artur Fierka <artur.fierka@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
This commit is contained in:
Artur Fierka
2026-09-08 09:42:46 +08:00
committed by GitHub
co-authored by Claude
parent 06334fae2d
commit 9dbdf8e9af
3 changed files with 120 additions and 3 deletions
@@ -70,7 +70,11 @@ class CompressedTensorsWNA16MoEMethod(CompressedTensorsMoEMethod):
self.num_bits = weight_quant.num_bits
self.packed_factor = Fraction(32, weight_quant.num_bits)
self.strategy = weight_quant.strategy
self.group_size = weight_quant.group_size
# Per-channel strategies leave group_size unset; -1 is the in-tree
# encoding for that, as in CompressedTensorsWNA16 and siblings.
self.group_size = (
-1 if weight_quant.group_size is None else weight_quant.group_size
)
self.actorder = weight_quant.actorder
# Extract quant_type and create weight key for oracle selection