3 people ba1cdcfcf0 [Model][Quantization] Add Ling-3.0-flash-fp8 support (#51265) ...

Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-08-09 23:09:08 -07:00

..

configs

[AMD][QWEN3-NEXT] FP8 Tunings (#32042)

2026-01-27 09:34:13 +00:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

flashinfer_fp4_moe.py

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

2026-08-07 05:32:52 -07:00

flashinfer_mxint4_moe.py

[RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214)

2026-07-20 16:45:10 -07:00

flashinfer_utils.py

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

fp8_utils.py

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

2026-08-07 05:32:52 -07:00

gptq_utils.py

[MoE Refactor] Migrate MoeWNA16Method quantization method over to using the new MK oracle scheme. (#44120)

2026-07-21 19:20:30 -07:00

humming_utils.py

[Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)

2026-08-07 10:03:19 -07:00

int8_utils.py

[CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781)

2026-07-08 12:12:54 +00:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

[Refactor] Remove multiple dead code (#47329)

2026-07-06 07:54:08 -07:00

marlin_utils_fp4.py

[Bugfix] Preserve Marlin runtime tensor storage across weight reload (#48438)

2026-07-30 14:50:03 -07:00

marlin_utils_fp8.py

[Bugfix] Preserve Marlin runtime tensor storage across weight reload (#48438)

2026-07-30 14:50:03 -07:00

marlin_utils_test.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

marlin_utils.py

[MoE Refactor] Combine CompressedTensorsWNA16MarlinMoEMethod with CompressedTensorsWNA16MoEMethod (#44570)

2026-07-31 14:13:03 -07:00

mxfp4_utils.py

[Online quantization] Add online MXFP4 quantization support (#49347)

2026-08-07 12:39:46 -07:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

nvfp4_emulation_utils.py

[Refactor] Remove dead code in multiple files (#49745)

2026-07-27 15:58:26 -04:00

nvfp4_utils.py

[Refactor] Move NVFP4 GEMM management into NvFp4LinearKernel (#39129)

2026-04-09 15:05:36 -04:00

ocp_mx_utils.py

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008)

2026-02-10 10:08:05 -05:00

quant_utils.py

[Model][Quantization] Add Ling-3.0-flash-fp8 support (#51265)

2026-08-09 23:09:08 -07:00

w8a8_utils.py

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799)

2026-03-23 16:03:29 -04:00