Isotr0py 1f1b1bc03b [V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) ...

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>

2025-05-27 04:40:28 +00:00

..

compressed_tensors

[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454)

2025-05-23 16:16:26 -07:00

kernels

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

quark

[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454)

2025-05-23 16:16:26 -07:00

utils

[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454)

2025-05-23 16:16:26 -07:00

__init__.py

[Minor] Rename quantization nvfp4 to modelopt_fp4 (#18356)

2025-05-20 09:08:37 -07:00

aqlm.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

auto_round.py

FIX MOE issue in AutoRound format (#18586)

2025-05-23 22:01:40 -07:00

awq_marlin.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

awq_triton.py

[Bugfix] Fix triton import with local TritonPlaceholder (#17446)

2025-05-06 17:53:09 +08:00

awq.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

base_config.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

bitblas.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

bitsandbytes.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

deepspeedfp.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

experts_int8.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

fbgemm_fp8.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

fp8.py

[Misc] Reduce logs on startup (#18649)

2025-05-24 23:03:53 -07:00

gguf.py

[V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646)

2025-05-27 04:40:28 +00:00

gptq_bitblas.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

gptq_marlin_24.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

gptq_marlin.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

gptq.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

hqq_marlin.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

ipex_quant.py

[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to requirements/cpu.txt (#18542)

2025-05-23 04:38:42 -07:00

kv_cache.py

Fix noisy warning for uncalibrated q_scale/p_scale (#17414)

2025-05-08 15:56:59 -04:00

marlin.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

modelopt.py

[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454)

2025-05-23 16:16:26 -07:00

moe_wna16.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

neuron_quant.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

ptpc_fp8.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

qqq.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

schema.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00

torchao.py

Add support for loading torchao models with AOPerModuleConfig (#17826)

2025-05-14 16:24:59 -07:00

tpu_int8.py

Update deprecated type hinting in model_executor/layers (#18056)

2025-05-13 04:17:23 -07:00