Kunshang Ji 55d037e2e5 [CT][FP8][Marlin] refactor CompressedTensorsW8A16Fp8 to use kernel abstraction (#38244) ...

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>

2026-04-10 09:58:35 +08:00

..

compressed_tensors

[CT][FP8][Marlin] refactor CompressedTensorsW8A16Fp8 to use kernel abstraction (#38244)

2026-04-10 09:58:35 +08:00

online

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)

2026-04-09 08:50:39 +08:00

quark

[Quantization] Support Quark W8A8 INT8 MoE inference (#36320)

2026-04-09 17:24:43 +00:00

utils

[Refactor] Move NVFP4 GEMM management into NvFp4LinearKernel (#39129)

2026-04-09 15:05:36 -04:00

__init__.py

[Quantization][Deprecation] Remove Petit NVFP4 (#32694)

2026-04-05 00:07:45 +00:00

awq_marlin.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

base_config.py

[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698)

2026-03-30 15:49:23 +00:00

bitsandbytes.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

cpu_wna16.py

[CPU] Support int8 compute mode in CPU AWQ (#35697)

2026-03-31 15:27:37 +08:00

experts_int8.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

fbgemm_fp8.py

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)

2026-04-09 08:50:39 +08:00

fp8.py

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)

2026-04-09 08:50:39 +08:00

fp_quant.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

gguf.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

gptq_marlin.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

gptq.py

[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698)

2026-03-30 15:49:23 +00:00

inc.py

[Quantization][Autoround][XPU] Add W4A16 Support (#37986)

2026-03-31 16:48:24 +00:00

input_quant_fp8.py

[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083)

2026-03-26 01:21:47 -07:00

kv_cache.py

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378)

2026-04-02 08:13:26 -04:00

modelopt.py

[Refactor] Move NVFP4 GEMM management into NvFp4LinearKernel (#39129)

2026-04-09 15:05:36 -04:00

moe_wna16.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

mxfp4.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

mxfp8.py

[Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664)

2026-04-01 09:41:42 -07:00

qutlass_utils.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00