4 people 969bbc7c61 [Model] Add MiMo-V2-Flash support (#30836) ...

Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: Jumiar <liuanqim10@126.com>
Signed-off-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jumiar <liuanqim10@126.com>
Co-authored-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

2025-12-19 17:17:03 +00:00

..

compressed_tensors

[Bug] Fix compressed tensor not using deepgemm (#30820)

2025-12-18 14:45:55 -05:00

kernels

[Quantization] enable compressed-tensors marlin support for turing (#31000)

2025-12-18 20:29:48 -08:00

quark

[Quantization] Support Quark int4-fp8 w4a8 for MoE (#30071)

2025-12-18 04:20:42 +00:00

utils

[Model] Add MiMo-V2-Flash support (#30836)

2025-12-19 17:17:03 +00:00

__init__.py

[CPU] Refactor CPU WNA16 (#28826)

2025-11-19 10:32:00 +08:00

auto_round.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

awq_marlin.py

[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901)

2025-12-16 14:35:28 -08:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

base_config.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

bitsandbytes.py

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066)

2025-12-09 13:48:25 -08:00

cpu_wna16.py

[CPU] Refactor CPU WNA16 (#28826)

2025-11-19 10:32:00 +08:00

deepspeedfp.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

experts_int8.py

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066)

2025-12-09 13:48:25 -08:00

fbgemm_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

fp8.py

fix fp8 online quantization streaming with tp > 1 (#30900)

2025-12-18 11:45:15 -05:00

fp_quant.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

gguf.py

fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408)

2025-12-12 23:10:12 +08:00

gptq_bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

gptq_marlin_24.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

gptq_marlin.py

[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901)

2025-12-16 14:35:28 -08:00

gptq.py

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

2025-10-23 23:26:13 -04:00

hqq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

inc.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_quant_fp8.py

[ROCm] Aiter Quant Kernels (#25552)

2025-12-09 14:27:37 +00:00

ipex_quant.py

[XPU] fix broken fp8 online quantization for XPU platform (#30831)

2025-12-17 00:28:13 -08:00

kv_cache.py

[Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480)

2025-12-09 13:54:32 -08:00

modelopt.py

[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901)

2025-12-16 14:35:28 -08:00

moe_wna16.py

[Bugfix] fix _get_quant_method of FusedMoE for deepseekV3.2 on non-NV… (#30057)

2025-12-14 02:20:51 -08:00

mxfp4.py

[LoRA] Set default MXFP4 LoRA backend to Marlin (#30598)

2025-12-18 08:42:22 -08:00

petit.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

ptpc_fp8.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

qutlass_utils.py

[MISC] fix import violations for re and triton modules (#26654)

2025-10-16 03:38:27 -07:00

rtn.py

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066)

2025-12-09 13:48:25 -08:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

Support using Int4PreshuffledTensor after loading (#26066)

2025-11-04 06:00:57 -05:00

tpu_int8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00