Kate ChengandJhao-Ting Chen cc6dafaef2 [Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213) ...

Signed-off-by: Kate Cheng <yunhsuanc@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Jhao-Ting Chen <jhaotingc@nvidia.com>

2026-01-07 10:53:54 -05:00

..

compressed_tensors

[Misc] Improve error messages for unsupported types and parameters (#30593)

2026-01-07 09:00:16 +00:00

kernels

[Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808)

2026-01-07 16:07:16 +08:00

quark

[MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499)

2025-12-29 13:27:00 -08:00

utils

[Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213)

2026-01-07 10:53:54 -05:00

__init__.py

[Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808)

2026-01-07 16:07:16 +08:00

auto_round.py

[Misc] Improve error messages for unsupported types and parameters (#30593)

2026-01-07 09:00:16 +00:00

awq_marlin.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

awq_triton.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

awq.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

base_config.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

bitsandbytes.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

cpu_wna16.py

[Quantization][Refactor] Move CPU GPTQ kernel into MP linear (#31801)

2026-01-06 19:10:18 +00:00

deepspeedfp.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

experts_int8.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

fbgemm_fp8.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

fp8.py

[MoE Refactor][14/N] Clean Up FI Quant Config Smuggling (#31593)

2026-01-06 15:47:04 +00:00

fp_quant.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

gguf.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

gptq_bitblas.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

gptq_marlin_24.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

gptq_marlin.py

[Quantization][Refactor] Move CPU GPTQ kernel into MP linear (#31801)

2026-01-06 19:10:18 +00:00

gptq.py

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

2025-10-23 23:26:13 -04:00

hqq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

inc.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_quant_fp8.py

[Bugfix][Hardware][AMD] Consolidate FP8 min/max values helper function (#31106)

2026-01-07 06:55:03 +00:00

ipex_quant.py

[XPU] enable fp8 online streaming quantization (#30944)

2025-12-20 13:45:27 +00:00

kv_cache.py

[Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480)

2025-12-09 13:54:32 -08:00

modelopt.py

[MoE Refactor][14/N] Clean Up FI Quant Config Smuggling (#31593)

2026-01-06 15:47:04 +00:00

moe_wna16.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

mxfp4.py

[Misc] Improve error messages for unsupported types and parameters (#30593)

2026-01-07 09:00:16 +00:00

petit.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

ptpc_fp8.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

qutlass_utils.py

[MISC] fix import violations for re and triton modules (#26654)

2025-10-16 03:38:27 -07:00

rtn.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torchao.py

Support using Int4PreshuffledTensor after loading (#26066)

2025-11-04 06:00:57 -05:00