4 people 4f2af1a7c0 [Feature] TurboQuant: support hybrid models and uniform quantization (#39931) ...

Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Jim Smith <jhsmith0@me.com>
Co-authored-by: Jim Smith <jhsmith0@me.com>
Co-authored-by: Sandermage <sandermage@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>

2026-05-04 20:14:01 -04:00

..

compressed_tensors

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

online

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

quark

[ROCm][Bugfix][GPTOSS]: fix input_ids and expert_map args for quark w4a8 gptoss (#41165)

2026-04-29 16:39:01 -07:00

turboquant

[Feature] TurboQuant: support hybrid models and uniform quantization (#39931)

2026-05-04 20:14:01 -04:00

utils

[Quantization] add humming mxfp4 moe backend (#41083)

2026-05-02 18:36:03 -07:00

__init__.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

awq_marlin.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

base_config.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

bitsandbytes.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

cpu_wna16.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

experts_int8.py

[Quantization] Consolidate experts_int8 with fp8 online quantization (#38463)

2026-04-16 13:12:20 -07:00

fbgemm_fp8.py

[ROCm][FEAT] Integrate aiter gemm w8a8 ptpc (#33773)

2026-04-16 09:55:29 +08:00

fp8.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

fp_quant.py

[MyPy] Enable mypy for vllm/model_executor/layers/ (#40159)

2026-04-21 20:15:02 -07:00

gguf.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

gptq_marlin.py

[MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990)

2026-04-23 05:21:47 +00:00

gptq.py

[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698)

2026-03-30 15:49:23 +00:00

humming.py

[Quantization] add humming mxfp4 moe backend (#41083)

2026-05-02 18:36:03 -07:00

inc.py

[Quantization][Autoround][CPU] Add W4A16 Support (#38192)

2026-04-15 18:38:31 +08:00

input_quant_fp8.py

[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083)

2026-03-26 01:21:47 -07:00

kv_cache.py

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378)

2026-04-02 08:13:26 -04:00

modelopt.py

Add nvfp4 kv cache support (#40177)

2026-05-01 04:55:16 +00:00

moe_wna16.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

mxfp4.py

[Quantization] add humming mxfp4 moe backend (#41083)

2026-05-02 18:36:03 -07:00

qutlass_utils.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00