4 people 97a668152b [RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214) ...

Signed-off-by: Xuanyu Zhang <xuanyu.zhang@mistral.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>

2026-07-20 16:45:10 -07:00

..

configs

[AMD][QWEN3-NEXT] FP8 Tunings (#32042)

2026-01-27 09:34:13 +00:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

allspark_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

flashinfer_fp4_moe.py

[Bugfix][NVFP4 MoE] Pad gated intermediate to 64 for FlashInfer TRT-LLM shuffle (M%128) (#46880)

2026-07-15 17:37:15 -04:00

flashinfer_mxint4_moe.py

[RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214)

2026-07-20 16:45:10 -07:00

flashinfer_utils.py

[Refactor] Remove multiple dead code (#47329)

2026-07-06 07:54:08 -07:00

fp8_utils.py

[Doc] Sync four function docstrings with their signatures (#45437)

2026-07-14 13:10:13 -04:00

gptq_utils.py

Revert "[MoE Refactor] Migrate MoeWNA16Method quantization to MK orac… (#44033)

2026-05-29 16:45:29 -07:00

humming_utils.py

[Bugfix] Fix activation quantization dispatch for WNA4Int/WNA8Int (#48785)

2026-07-16 17:13:02 -04:00

int8_utils.py

[CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781)

2026-07-08 12:12:54 +00:00

layer_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

machete_utils.py

[Refactor] Remove multiple dead code (#47329)

2026-07-06 07:54:08 -07:00

marlin_utils_fp4.py

[Quantization] Bound peak memory when repacking FP4 MoE weights for Marlin (#47851)

2026-07-10 19:46:13 -06:00

marlin_utils_fp8.py

[Kernel] Extend Marlin thread-tile padding to MoE (WNA16 + FP8/MXFP8) (#45703)

2026-06-23 11:45:10 -07:00

marlin_utils_test.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

marlin_utils.py

[Refactor] Remove multiple dead code (#47329)

2026-07-06 07:54:08 -07:00

mxfp4_utils.py

[Bugfix] Patch Hopper MXFP4 OOB scales reads leading to NaN (#47910)

2026-07-07 22:51:22 +00:00

mxfp6_utils.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

mxfp8_utils.py

[DSV4] Better MXFP8 quantization kernel (#47229)

2026-07-01 14:33:51 -07:00

nvfp4_emulation_utils.py

[NVFP4][Emulation] Fuse NVFP4 weight dequantization with compute in triton kernel for w13/w2 MOE MLP linears (#44667)

2026-06-25 19:33:00 -07:00

nvfp4_utils.py

[Refactor] Move NVFP4 GEMM management into NvFp4LinearKernel (#39129)

2026-04-09 15:05:36 -04:00

ocp_mx_utils.py

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008)

2026-02-10 10:08:05 -05:00

quant_utils.py

[CPU][BugFix] Multiple fixes to w4a8_int8 CPU MoE path (#46739)

2026-07-06 05:39:20 +00:00

w8a8_utils.py

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799)

2026-03-23 16:03:29 -04:00