Matej SirovatkaandJee Jee Li 3ac9525507 [Bugfix][Quantization] Reuse online NVFP4 MoE kernel across reloads (#50074) ...

Signed-off-by: S1ro1 <matej.sirovatka@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>

2026-08-12 14:06:53 +08:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

reference_mxfp4.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_auto_awq.py

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

test_auto_gptq.py

[Bugfix] Size and iterate w13 by shard count for non-gated MoE (#51125)

2026-08-05 17:24:47 -07:00

test_auto_round.py

[Bugfix] Size and iterate w13 by shard count for non-gated MoE (#51125)

2026-08-05 17:24:47 -07:00

test_blackwell_moe.py

[Bugfix][MoE] Restore routed output unpadding before shared expert add (#45707)

2026-06-16 16:06:28 +03:00

test_compressed_tensors.py

[MoE Refactor] Combine CompressedTensorsWNA16MarlinMoEMethod with CompressedTensorsWNA16MoEMethod (#44570)

2026-07-31 14:13:03 -07:00

test_configs.py

[CI] Fix test_auto_gptq on ROCm CI (#46164)

2026-06-23 16:38:06 -05:00

test_cpu_offload.py

[CI] Stabilize cpu offload compressed tensors test (#41102)

2026-05-04 05:22:42 +00:00

test_cpu_w8a8.py

[CPU] Support cpu compressed-tensor w8a8 int8 moe (#42920)

2026-06-29 03:04:05 +00:00

test_cpu_wna16.py

[CPU] Support CPU W4A16 INT4 MoE (#43409)

2026-06-12 07:12:37 +00:00

test_cutlass_w4a16.py

[AMD] skip machete tests for rocm (#42326)

2026-05-13 12:11:03 +00:00

test_experts_int8.py

[CI Bug] Fix Chunked prefill is required for mamba cache mode 'align'. (#51177)

2026-08-05 11:33:45 -07:00

test_fp8_per_channel.py

[Quantization] add online fp8 ptpc (#44132)

2026-06-08 22:42:11 +08:00

test_fp8.py

[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)

2026-08-03 11:15:13 -04:00

test_gfx950_moe.py

[AMD] Revert Mxfp4MoeBackend.TRITON_UNFUSED fallback (#46491)

2026-07-27 22:31:23 -05:00

test_gptq_dynamic.py

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

test_gptq_v2.py

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

test_humming_ignore.py

[Bug][Quantization] Fix humming is_layer_skipped for compressed-tensors "re:" ignore entries (#48507)

2026-07-16 07:47:42 -07:00

test_int8_moe_oracle.py

[ROCm][Quantization][5/N] Refactor quark_moe w8a8-int8 w/ oracle (#46765)

2026-07-27 16:01:34 -05:00

test_lm_head.py

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

test_mixed_precision.py

[CI] Add TP=4 requirement to test_mixed_precision_model_accuracies (#46161)

2026-06-22 18:19:43 -05:00

test_modelopt.py

[Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)

2026-08-05 14:08:55 -07:00

test_moe_wna16.py

[Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)

2026-08-07 10:03:19 -07:00

test_online_mxfp4.py

[Online quantization] Add online MXFP4 quantization support (#49347)

2026-08-07 12:39:46 -07:00

test_online.py

[Bugfix][Quantization] Reuse online NVFP4 MoE kernel across reloads (#50074)

2026-08-12 14:06:53 +08:00

test_per_token_kv_cache.py

[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)

2026-08-03 11:15:13 -04:00

test_quantization_config_args.py

[Quantization] Rework quantization_config to use QuantKey and allow for activation override (#41566)

2026-05-13 16:58:32 -04:00

test_quark.py

[Model][Quantization] Add Ling-3.0-flash-fp8 support (#51265)

2026-08-09 23:09:08 -07:00

test_register_quantization_config.py

[chores][log] change registry log from warning to debug (#43045)

2026-05-26 00:13:46 -07:00

test_torchao.py

[ROCm][CI] Skip three torchao tests of gfx950 until torchao==0.18 is released (#49732)

2026-07-27 09:36:38 +00:00

test_trtllm_nvfp4_hidden_dim_padding.py

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

2026-08-07 05:32:52 -07:00

test_turboquant.py

[Bugfix][TurboQuant] Add KV quant mode for turboquant (#50533)

2026-07-31 17:42:32 +00:00

utils.py

[XPU] Add online fp8 quantization test (#44513)

2026-07-28 10:34:33 +08:00