[Misc][Quark] Upstream Quark format to VLLM (#10765)

Signed-off-by: kewang-xlnx <kewang@xilinx.com>
Signed-off-by: kewang2 <kewang2@amd.com>
Co-authored-by: kewang2 <kewang2@amd.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
This commit is contained in:
kewang-xlnx
2025-01-15 11:05:15 -05:00
committed by GitHub
co-authored by kewang2 Michael Goin
parent 5ecf3e0aaf
commit de0526f668
32 changed files with 1264 additions and 70 deletions
@@ -133,3 +133,6 @@ class QuantizationConfig(ABC):
method.
"""
raise NotImplementedError
def get_cache_scale(self, name: str) -> Optional[str]:
return None