Jee Jee Li 88e1b11313 [Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606) ...

Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>

2026-08-26 01:46:56 +00:00

..

__init__.py

[torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731)

2026-02-06 04:19:49 -08:00

act_quant_fusion.py

[XPU] Enable rms_norm/act quant fusions (#43963)

2026-06-02 16:14:41 +00:00

add_rms_fusion.py

[Compilation]Fuse Transformers Residual Add + RMSNorm (#48757)

2026-07-30 13:46:36 +00:00

allreduce_rms_fusion.py

[Perf] Tune FlashInfer all-reduce thresholds for single-node TP8 on SM103 (#53606)

2026-08-26 01:46:56 +00:00

attn_quant_fusion.py

[compile] Allow strings in custom ops without regressing compilation times (#38123)

2026-04-10 07:26:37 +00:00

collective_fusion.py

[Kernel][Performance] Add FlashInfer cutedsl NVFP4 GEMM backend (#42235)

2026-06-22 16:17:18 -04:00

matcher_utils.py

[Refactor] Move fla to third party (#48500)

2026-07-16 19:22:36 +01:00

mla_attn_quant_fusion.py

[compile] mla + group fp8 fusion (#38877)

2026-04-21 23:16:58 -04:00

mla_rope_kvcache_cat_fusion.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

qk_norm_rope_fusion.py

[Model][Hardware][AMD]: Part 1/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_AITER_FA, and ROCM_AITER_UNIFIED_ATTN (#42749)

2026-07-16 17:39:04 -05:00

qk_norm_rope_kvcache_fusion.py

[Model][Hardware][AMD]: Part 1/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_AITER_FA, and ROCM_AITER_UNIFIED_ATTN (#42749)

2026-07-16 17:39:04 -05:00

rms_quant_fusion.py

[Bugfix] Guard CUDA-only rms_norm_per_block_quant in FUSED_OPS for non-CUDA builds (#47296)

2026-07-09 10:10:53 -04:00

rocm_aiter_fusion.py

[ROCm] Enable AITER and FP8 inference on GFX120x (#43615)

2026-08-03 16:45:37 -05:00

rope_kvcache_fusion.py

[compile] Fix fake kernel return dtype (#50444)

2026-07-30 19:50:02 +00:00

sequence_parallelism.py

[XPU] Enable sequence parallel support for XPU (#38608)

2026-06-14 19:26:46 -07:00