6 people e77daef89e [Model] Support DeepSeek-V4.1-Flash (#56214) ...

Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-11 02:11:19 -07:00

..

configs

[AMD][QWEN3-NEXT] FP8 Tunings (#32042)

2026-01-27 09:34:13 +00:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

b12x_moe.py

[Kernel] Add b12x FP4 MoE backend (#52018)

2026-08-21 08:04:36 -07:00

config_utils.py

[Online quantization] Add targeted online quantization configuration based on user patterns (#51285)

2026-09-02 08:55:15 -04:00

flashinfer_fp4_moe.py

[Bugfix] Fix Kimi K3 NVFP4 MoE weight conversion OOM (#55407)

2026-09-07 11:45:25 +08:00

flashinfer_mxint4_moe.py

Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)

2026-08-21 12:39:28 -06:00

flashinfer_utils.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

fp8_utils.py

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

gptq_utils.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

humming_utils.py

[Quantization][Humming] Support MXFP4 weight + block-FP8 activation for MoE (#51332)

2026-08-25 10:21:00 -04:00

int8_utils.py

[Refactor] Remove dead code for quantization (#52221)

2026-08-16 13:10:16 -04:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

[Refactor] Remove multiple dead code (#47329)

2026-07-06 07:54:08 -07:00

marlin_utils_fp4.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

marlin_utils_fp8.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

marlin_utils_test.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

marlin_utils.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

mxfp4_utils.py

[Refactor] Remove dead code for quantization (#52221)

2026-08-16 13:10:16 -04:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

nvfp4_emulation_utils.py

[Spec Decode] Add NVFP4 DSpark gathered top-k projection (#55713)

2026-09-09 17:33:46 +00:00

nvfp4_utils.py

[Fast Start] Support fp4 (#55465)

2026-09-10 13:22:17 +00:00

ocp_mx_utils.py

[Quantization][Refactor][1/N] Adopt QuantKey in QuarkConfig and methods, relying on weight_quant_key, act_quant_key for quant method dispatch (#52958)

2026-09-01 02:55:54 -05:00

quant_utils.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

w8a8_utils.py

[Refactor] Remove dead code quantization 2 (#52821)

2026-08-25 20:28:44 -07:00