3 people e8ebbdde83 [Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251) ...

Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2026-04-06 11:57:53 -07:00

..

compressed_tensors

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

online

[Frontend] new online quantization frontend (#38138)

2026-04-03 11:58:39 -04:00

quark

[ROCm][Quantization][1/N] Refactor quark_moe w_mxfp4 w/ oracle (#38774)

2026-04-03 03:29:57 +00:00

utils

[Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251)

2026-04-06 11:57:53 -07:00

__init__.py

[Quantization][Deprecation] Remove Petit NVFP4 (#32694)

2026-04-05 00:07:45 +00:00

awq_marlin.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

base_config.py

[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698)

2026-03-30 15:49:23 +00:00

bitsandbytes.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

cpu_wna16.py

[CPU] Support int8 compute mode in CPU AWQ (#35697)

2026-03-31 15:27:37 +08:00

experts_int8.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

fbgemm_fp8.py

[FP8]add FP8 WoQ kernel abstraction. (#32929)

2026-03-23 09:47:47 +00:00

fp8.py

[Frontend] new online quantization frontend (#38138)

2026-04-03 11:58:39 -04:00

fp_quant.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

gguf.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

gptq_marlin.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

gptq.py

[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698)

2026-03-30 15:49:23 +00:00

inc.py

[Quantization][Autoround][XPU] Add W4A16 Support (#37986)

2026-03-31 16:48:24 +00:00

input_quant_fp8.py

[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083)

2026-03-26 01:21:47 -07:00

kv_cache.py

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378)

2026-04-02 08:13:26 -04:00

modelopt.py

[Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664)

2026-04-01 09:41:42 -07:00

moe_wna16.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

mxfp4.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

mxfp8.py

[Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664)

2026-04-01 09:41:42 -07:00

qutlass_utils.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00