3 people 284cc92275 [MISC] cudagraph_capture_sizes related improvements (#26016) ...

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-10-24 05:11:05 -07:00

..

compressed_tensors

[bugfix] remove unused parameters to reduce unnecessary vram usage (#26789)

2025-10-22 08:16:09 -07:00

kernels

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

2025-10-23 23:26:13 -04:00

quark

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

utils

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729)

2025-10-21 01:51:14 -04:00

__init__.py

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440)

2025-10-10 09:43:40 -07:00

auto_round.py

[Feature][Quantization] auto_round support for mixed bits quantization (#23812)

2025-10-20 22:23:30 +00:00

awq_marlin.py

[Bugfix] Fix AWQ marlin layer skipping (#27416)

2025-10-23 18:30:28 +00:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Quantization] Automatically infer AWQ modules_to_not_convert field (#26909)

2025-10-21 01:49:28 +00:00

base_config.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

bitsandbytes.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

deepspeedfp.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

experts_int8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

fbgemm_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

fp8.py

[Chore] Separate out optional dependency checks from vllm.utils (#27207)

2025-10-22 10:44:21 -04:00

fp_quant.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

gguf.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

gptq_bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

gptq_marlin_24.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

gptq_marlin.py

[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)

2025-10-19 05:20:55 -07:00

gptq.py

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

2025-10-23 23:26:13 -04:00

hqq_marlin.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

inc.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_quant_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ipex_quant.py

[Quantization] Automatically infer AWQ modules_to_not_convert field (#26909)

2025-10-21 01:49:28 +00:00

kv_cache.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

modelopt.py

[Model] Add MoE support for NemotronH (#25863)

2025-10-23 10:27:23 +00:00

moe_wna16.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

mxfp4.py

[MISC] cudagraph_capture_sizes related improvements (#26016)

2025-10-24 05:11:05 -07:00

petit.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ptpc_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

qutlass_utils.py

[MISC] fix import violations for re and triton modules (#26654)

2025-10-16 03:38:27 -07:00

rtn.py

[CI Failure] Fix torchao dep failure for Quantization Test (#26824)

2025-10-14 16:41:43 -07:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

tpu_int8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00