[Quantization][Bugfix] Bump humming-kernels to 0.1.16 (#58054)
Signed-off-by: jinzhen.ljz <jinzhen.ljz@antgroup.com> Co-authored-by: Codex <noreply@openai.com> Co-authored-by: Misha Goin <mgoin64@gmail.com>
This commit is contained in:
co-authored by
Codex
Misha Goin
parent
9f07d023d0
commit
f69cc7c178
@@ -33,4 +33,4 @@ quack-kernels==0.6.5 # Required by MSA
|
||||
tokenspeed-mla==0.1.8; platform_system == "Linux"
|
||||
|
||||
# Humming kernels for quantization gemm
|
||||
humming-kernels[cu13]==0.1.15
|
||||
humming-kernels[cu13]==0.1.16
|
||||
|
||||
@@ -3,6 +3,5 @@ accuracy_threshold: 0.39
|
||||
num_questions: 1319
|
||||
num_fewshot: 5
|
||||
server_args: >-
|
||||
--enforce-eager
|
||||
--max-model-len 8192
|
||||
--linear-backend humming
|
||||
|
||||
@@ -3,7 +3,6 @@ accuracy_threshold: 0.86
|
||||
num_questions: 1319
|
||||
num_fewshot: 5
|
||||
server_args: >-
|
||||
--enforce-eager
|
||||
--max-model-len 8192
|
||||
--moe-backend humming
|
||||
--linear-backend humming
|
||||
|
||||
Reference in New Issue
Block a user