vLLM/vllm/model_executor/layers/quantization at 39d28108f46ac320bccdf76e84640dbf2bd02bb4 - vLLM

compressed_tensors

[Bugfix] Fix mismatched nvfp4 gemm output shape (#29742 )

2025-11-30 09:15:01 +00:00

kernels

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

quark

[Doc]: fixing typos in various files. (#29717 )

2025-11-29 01:15:39 -08:00

utils

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

__init__.py

[CPU] Refactor CPU WNA16 (#28826 )

2025-11-19 10:32:00 +08:00

auto_round.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

awq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

awq.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

base_config.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

bitsandbytes.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

cpu_wna16.py

[CPU] Refactor CPU WNA16 (#28826 )

2025-11-19 10:32:00 +08:00

deepspeedfp.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

experts_int8.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

fbgemm_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

fp8.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

fp_quant.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908 )

2025-10-18 09:48:22 -07:00

gguf.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

gptq_bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

gptq_marlin_24.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

gptq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

gptq.py

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092 )

2025-10-23 23:26:13 -04:00

hqq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722 )

2025-11-29 07:19:33 -08:00

inc.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

input_quant_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

ipex_quant.py

[CPU] Refactor CPU WNA16 (#28826 )

2025-11-19 10:32:00 +08:00

kv_cache.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

modelopt.py

[Feat] Support non-gated activations in NVFP4 modelopt path (#29004 )

2025-11-30 11:02:40 -05:00

moe_wna16.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

mxfp4.py

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708 )

2025-11-30 10:37:25 +08:00

petit.py

[Attention] Update attention imports (#29540 )

2025-11-27 11:19:09 -05:00

ptpc_fp8.py

[Attention] Update attention imports (#29540 )

2025-11-27 11:19:09 -05:00

qutlass_utils.py

[MISC] fix import violations for re and triton modules (#26654 )

2025-10-16 03:38:27 -07:00

rtn.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

torchao.py

Support using Int4PreshuffledTensor after loading (#26066 )

2025-11-04 06:00:57 -05:00

tpu_int8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00