iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
db986c19ea35d7f3522a45d5205bf5d3ffab14e4
vLLM/vllm/model_executor/layers/quantization/utils/configs
T
History
rasmith ed0de3e4b8 [AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
..
N=256,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=256,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=512,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=512,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=512,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=576,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=576,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=576,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=576,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=1536,K=1536,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=1536,K=1536,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=1536,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=1536,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=1536,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=2048,K=512,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=2048,K=512,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=2048,K=512,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=2304,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=2304,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=2304,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=3072,K=1536,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=3072,K=1536,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=3072,K=1536,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=3072,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=3072,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=3072,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=3072,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=4096,K=512,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=4096,K=512,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=4096,K=512,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=4096,K=512,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=4608,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=4608,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=4608,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=4608,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=128,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=128,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=256,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=256,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=7168,K=256,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=1024,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=1024,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=1024,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=1152,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=1152,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=1152,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=2048,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=2048,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=7168,K=2048,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=2048,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=2304,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=2304,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=7168,K=2304,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=2304,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=8192,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=16384,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=16384,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=7168,K=16384,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=16384,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=18432,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=7168,K=18432,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=7168,K=18432,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=7168,K=18432,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=8192,K=1536,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=24576,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=24576,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=24576,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=24576,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=32768,K=512,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=32768,K=512,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128,128].json
[MISC] Check space in the file names in the pre commit checks (#12804)
2025-02-06 15:36:21 -08:00
N=32768,K=512,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=32768,K=512,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=36864,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128,128].json
[AMD] [Model] DeepSeek tunings (#13199)
2025-02-15 03:58:09 -08:00
N=36864,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00
N=36864,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128,128].json
[Misc][Easy] Remove the space from the file name
2025-02-05 19:23:35 -08:00