sychen52 947138b6c2 Add nvfp4 kv cache support (#40177) ...

Signed-off-by: Shiyang Chen <shiychen@nvidia.com>

2026-05-01 04:55:16 +00:00

..

compressed_tensors

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

online

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

quark

[ROCm][Bugfix][GPTOSS]: fix input_ids and expert_map args for quark w4a8 gptoss (#41165)

2026-04-29 16:39:01 -07:00

turboquant

[Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194)

2026-04-18 14:31:59 -04:00

utils

[DSV4] Add BF16 and MXFP8 A2A support for flashinfer a2a one sided (#40960)

2026-04-30 15:33:12 -07:00

__init__.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

awq_marlin.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

base_config.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

bitsandbytes.py

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

2026-04-01 09:44:08 -04:00

cpu_wna16.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

experts_int8.py

[Quantization] Consolidate experts_int8 with fp8 online quantization (#38463)

2026-04-16 13:12:20 -07:00

fbgemm_fp8.py

[ROCm][FEAT] Integrate aiter gemm w8a8 ptpc (#33773)

2026-04-16 09:55:29 +08:00

fp8.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

fp_quant.py

[MyPy] Enable mypy for vllm/model_executor/layers/ (#40159)

2026-04-21 20:15:02 -07:00

gguf.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

gptq_marlin.py

[MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990)

2026-04-23 05:21:47 +00:00

gptq.py

[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698)

2026-03-30 15:49:23 +00:00

humming.py

[Quantization] add humming quantization kernel (#34556)

2026-04-24 09:29:44 -04:00

inc.py

[Quantization][Autoround][CPU] Add W4A16 Support (#38192)

2026-04-15 18:38:31 +08:00

input_quant_fp8.py

[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083)

2026-03-26 01:21:47 -07:00

kv_cache.py

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378)

2026-04-02 08:13:26 -04:00

modelopt.py

Add nvfp4 kv cache support (#40177)

2026-05-01 04:55:16 +00:00

moe_wna16.py

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

2026-04-13 12:53:58 -04:00

mxfp4.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

qutlass_utils.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00