Lucas Wilkinsonandmgoin c5d55356f9 [Bugfix] fix for deepseek w4a16 (#8906) ...

Co-authored-by: mgoin <michael@neuralmagic.com>

2024-09-27 13:12:34 -06:00

..

compressed_tensors

[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear method (#7271)

2024-09-27 14:25:10 -04:00

kernels

[Bugfix] fix for deepseek w4a16 (#8906)

2024-09-27 13:12:34 -06:00

utils

[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear method (#7271)

2024-09-27 14:25:10 -04:00

__init__.py

[Hardware][NV] Add support for ModelOpt static scaling checkpoints. (#6112)

2024-09-11 00:38:40 -04:00

aqlm.py

[Kernel] fix types used in aqlm and ggml kernels to support dynamo (#7596)

2024-08-16 14:00:11 -07:00

awq_marlin.py

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)

2024-09-23 13:46:26 -04:00

awq_triton.py

[Kernel][Triton][AMD] Remove tl.atomic_add from awq_gemm_kernel, 2-5x speedup MI300, minor improvement for MI250 (#8646)

2024-09-21 09:20:54 +00:00

awq.py

[Misc] Update awq and awq_marlin to use vLLMParameters (#7422)

2024-08-13 17:08:20 -04:00

base_config.py

[Core] Support loading GGUF model (#5191)

2024-08-05 17:54:23 -06:00

bitsandbytes.py

[[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768)

2024-09-24 17:08:55 -07:00

deepspeedfp.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

experts_int8.py

[Model] Adding support for MSFT Phi-3.5-MoE (#7729)

2024-08-30 13:42:57 -06:00

fbgemm_fp8.py

[AMD][ROCm]Quantization methods on ROCm; Fix _scaled_mm call (#8380)

2024-09-18 10:41:08 -07:00

fp8.py

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

gguf.py

[Bugfix][Kernel] Add IQ1_M quantization implementation to GGUF kernel (#8357)

2024-09-15 16:51:44 -06:00

gptq_marlin_24.py

[Misc] Update gptq_marlin_24 to use vLLMParameters (#7762)

2024-08-26 17:44:54 -04:00

gptq_marlin.py

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)

2024-09-23 13:46:26 -04:00

gptq.py

[Kernel] Fullgraph and opcheck tests (#8479)

2024-09-25 08:35:52 -06:00

kv_cache.py

[Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints (#6761)

2024-07-25 09:46:15 -07:00

marlin.py

[Misc] Update marlin to use vLLMParameters (#7803)

2024-08-23 14:30:52 -04:00

modelopt.py

[Hardware][NV] Add support for ModelOpt static scaling checkpoints. (#6112)

2024-09-11 00:38:40 -04:00

neuron_quant.py

[Neuron] Adding support for adding/ overriding neuron configuration a… (#8062)

2024-09-04 16:33:43 -07:00

qqq.py

[Kernel] AQ AZP 3/4: Asymmetric quantization kernels (#7270)

2024-09-16 11:52:40 -07:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

tpu_int8.py

[misc] update tpu int8 to use new vLLM Parameters (#7973)

2024-08-29 16:46:55 -04:00