Simon DanielssonandCyrus Leung 432e1cbc23 [Bugfix]: Assertion error when using FlashInfer backend (#25933) ...

Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2025-10-05 16:46:36 +08:00

..

compressed_tensors

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696)

2025-10-02 19:35:13 +00:00

kernels

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

quark

[Bugfix] Fix import gemm_afp4wfp4 failure on AMD (#26068)

2025-10-02 22:37:25 -07:00

utils

[GPTOSS][DP/EP][Marlin] Enable GPTOSS DP/EP using Marlin kernels (#25488)

2025-10-03 20:13:13 -04:00

__init__.py

[V0 deprecation] Deprecate V0 Neuron backend (#21159)

2025-09-06 16:15:18 -07:00

auto_round.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

awq_marlin.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

awq_triton.py

[Doc]: fix typos in Python comments (#24173)

2025-09-04 08:52:17 -07:00

awq.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

base_config.py

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455)

2025-09-26 15:47:41 +00:00

bitblas.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

bitsandbytes.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

deepspeedfp.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

experts_int8.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

fbgemm_fp8.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

fp8.py

[Bugfix]: Assertion error when using FlashInfer backend (#25933)

2025-10-05 16:46:36 +08:00

gguf.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

gptq_bitblas.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

gptq_marlin_24.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

gptq_marlin.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

gptq.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

hqq_marlin.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

inc.py

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)

2025-07-16 15:33:41 -04:00

input_quant_fp8.py

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696)

2025-10-02 19:35:13 +00:00

ipex_quant.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

kv_cache.py

[Quantization/NVFP4] Speed up TRTLLM NVFP4 MOE weight loading and fix K/V scale loading for MLA Attn (#25968)

2025-10-03 19:35:06 +00:00

modelopt.py

[Quantization/NVFP4] Speed up TRTLLM NVFP4 MOE weight loading and fix K/V scale loading for MLA Attn (#25968)

2025-10-03 19:35:06 +00:00

moe_wna16.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

mxfp4.py

[GPTOSS][DP/EP][Marlin] Enable GPTOSS DP/EP using Marlin kernels (#25488)

2025-10-03 20:13:13 -04:00

petit.py

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527)

2025-08-22 20:53:21 -06:00

ptpc_fp8.py

[Misc] Removed force_fp8_e4m3fnuz from FP8LinearOp (#23725)

2025-09-04 09:25:40 -04:00

rtn.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

schema.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

torchao.py

Support RL online quantization with torchao (#23014)

2025-10-01 16:39:29 -07:00

tpu_int8.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00