Pavani Majety 598b6d7b07 [Bugfix/Core] Flashinfer k_scale and v_scale (#9861)

2024-11-01 12:15:05 -07:00

..

compressed_tensors

[torch.compile] support moe models (#9632)

2024-10-27 21:58:04 -07:00

kernels

[Kernel] Add Exllama as a backend for compressed-tensors (#9395)

2024-10-17 09:48:26 -04:00

utils

[Bugfix][VLM] Make apply_fp8_linear work with >2D input (#9812)

2024-10-29 19:49:44 -07:00

__init__.py

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

aqlm.py

…

awq_marlin.py

[torch.compile] support moe models (#9632)

2024-10-27 21:58:04 -07:00

awq_triton.py

[Kernel][Triton][AMD] Remove tl.atomic_add from awq_gemm_kernel, 2-5x speedup MI300, minor improvement for MI250 (#8646)

2024-09-21 09:20:54 +00:00

awq.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217)

2024-10-23 11:27:37 +00:00

base_config.py

…

bitsandbytes.py

[Bugfix] Fix layer skip logic with bitsandbytes (#9887)

2024-11-01 13:12:44 +08:00

deepspeedfp.py

…

experts_int8.py

…

fbgemm_fp8.py

[Hardware][ROCM] using current_platform.is_rocm (#9642)

2024-10-28 04:07:00 +00:00

fp8.py

[Hardware][ROCM] using current_platform.is_rocm (#9642)

2024-10-28 04:07:00 +00:00

gguf.py

[Core] Refactor GGUF parameters packing and forwarding (#8859)

2024-10-07 10:01:46 +00:00

gptq_marlin_24.py

…

gptq_marlin.py

[torch.compile] support moe models (#9632)

2024-10-27 21:58:04 -07:00

gptq.py

[Kernel] Fullgraph and opcheck tests (#8479)

2024-09-25 08:35:52 -06:00

ipex_quant.py

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

kv_cache.py

…

marlin.py

…

modelopt.py

[Bugfix/Core] Flashinfer k_scale and v_scale (#9861)

2024-11-01 12:15:05 -07:00

neuron_quant.py

[Neuron] Adding support for adding/ overriding neuron configuration a… (#8062)

2024-09-04 16:33:43 -07:00

qqq.py

[Kernel] AQ AZP 3/4: Asymmetric quantization kernels (#7270)

2024-09-16 11:52:40 -07:00

schema.py

…

tpu_int8.py

…