5 people f92b78f6ef [Kernel][DSV4.1] Fuse MXFP8 wo_b GEMM with sequence-parallel reduce-scatter (#57428) ...

Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Signed-off-by: Canlin <canlinguosdu@gmail.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

2026-09-22 01:07:17 -07:00

..

cpu

[Model] Add DeepSeek-V4 CPU backend (#55355)

2026-09-10 14:14:48 +08:00

deepgemm

Add platform manual_seed_all API (#38468)

2026-04-10 13:43:50 +08:00

ir

[Benchmark] Retire stale benchmarks and consolidate RMSNorm (#57083)

2026-09-16 13:21:43 -04:00

__init__.py

[vLLM IR] Add IR op testing and benchmarking infrastructure (#40167)

2026-04-21 00:23:03 +00:00

bench_concat_mla_q.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

bench_cp_gather_fp8.py

[Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642)

2026-07-16 22:44:04 +00:00

benchmark_2d_silu_mul_fp8_quant.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_activation.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_block_fp8_gemm.py

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)

2026-04-09 08:50:39 +08:00

benchmark_cp_gather.py

[Kernel] Optimize long-context MLA cache gathers (#51739)

2026-08-10 22:23:43 -07:00

benchmark_cutlass_moe_fp8.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_cutlass_moe_nvfp4.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_device_communicators.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_dsv41_mega_attn.py

[Model][DSv4.1] FlashMLA mega attention and the NVFP4 compressed KV cache (#56935)

2026-09-16 03:07:50 -07:00

benchmark_flydsl_moe_w4a16.py

[CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781)

2026-07-08 12:12:54 +00:00

benchmark_fp8_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_fused_collective.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_fused_moe_lora_one_shot.py

[LoRA] Add one shot triton kernel For MoE LoRA (#42290)

2026-05-25 19:47:04 -07:00

benchmark_fused_q_cutedsl.py

[Kernel][SM100] Add a CuTeDSL fused query kernel (#49792)

2026-08-04 15:23:06 -07:00

benchmark_fused_topk.py

[Kernel] Add topk_sigmoid kernel (#31246)

2026-01-21 22:49:51 +00:00

benchmark_gelu_and_mul_sparse.py

[Performance] Add Triton kernel for Gemma3n sparse GELU (#48498)

2026-09-14 07:42:15 +00:00

benchmark_gemm_rs_ar.py

[Kernel][DSV4.1] Fuse MXFP8 wo_b GEMM with sequence-parallel reduce-scatter (#57428)

2026-09-22 01:07:17 -07:00

benchmark_grouped_gemm_cutlass.py

[MoE] Move cutlass moe to fused_moe/experts/ (#40574)

2026-04-24 06:05:49 +00:00

benchmark_hy_v4_ihc.py

[Kernel][HY V4] Add Triton iHC pre/post fallback (#55059)

2026-09-05 23:12:50 +08:00

benchmark_inkling_qkvr_prep.py

[ROCm] [Model] Enable TML inkling (#48841)

2026-07-27 10:05:46 +00:00

benchmark_int8_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_k3_cutedsl_residual.py

[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089)

2026-07-29 14:10:58 +08:00

benchmark_kimi_k3_attn_res.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_kimi_k3_kda_decode.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_kimi_k3_kda_projection.py

[Kimi-K3] Overlap low-M TP8 KDA projections (#54697)

2026-09-02 03:35:28 +00:00

benchmark_kimi_k3_latent_moe_tail.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_kimi_k3_sp_collectives.py

[Model] Add Kimi K3 support: model files and kernels [1/N] (#50089)

2026-07-29 14:10:58 +08:00

benchmark_layernorm.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_lora.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_machete.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

benchmark_marlin.py

[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)

2026-09-08 12:45:12 -07:00

benchmark_mla_k_concat.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_moe_align_block_size.py

[Kernel][MoE] Optimize batched_moe_align_block_size with cooperative writes (#53280)

2026-09-11 12:05:22 -07:00

benchmark_moe_defaults.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

benchmark_moe_permute_unpermute.py

[Perf] Optimize moe permute by pre-allocate buffer, 9~14% kernel performance improvement (#43014)

2026-05-28 06:18:26 -07:00

benchmark_moe.py

[Bugfix] Add Kimi K3 MoE support to benchmark_moe.py (#50082)

2026-08-19 19:42:30 +00:00

benchmark_mrope.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_mxfp4_qutlass.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_quant.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_qutlass.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_paged_attention.py

Delete PagedAttention (#47361)

2026-07-02 12:31:26 -07:00

benchmark_per_token_group_quant.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_per_token_quant_fp8.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_persistent_topk.py

[Perf][Kernel] Add sampled filtering for persistent top-k (#56346)

2026-09-15 14:15:59 -07:00

benchmark_quant.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_rdna_hybrid_w4a16_gemm.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_relu_squared.py

[Kernel] Implement CUDA kernel for ReLUSquaredActivation (relu^2) (#39058)

2026-07-12 19:18:03 -07:00

benchmark_reshape_and_cache_flash.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_reshape_and_cache.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_rope.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_router_gemm.py

[Kernel] Retire the DSv3 router GEMM CUDA kernel (#54040)

2026-08-31 07:15:31 +00:00

benchmark_selective_state_update.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_shapes.py

Disable nm-testing models with issues in CI (#28206)

2025-11-06 06:19:07 -08:00

benchmark_silu_mul_fp8_quant.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_thinking_budget.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

benchmark_trtllm_decode_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_trtllm_prefill_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_vit_aiter_fp8_attn.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

benchmark_vit_bilinear_pos_embed.py

[Perf] triton bilinear_pos_embed kernel for ViT (#37948)

2026-04-01 01:52:02 -07:00

benchmark_vit_fp8_attn.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

benchmark_vocab_parallel_embedding.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

benchmark_w8a8_block_fp8.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

graph_machete_bench.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

requirements.txt

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)

2024-09-23 13:46:26 -04:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

weight_shapes.py

[kernel] Support W4A8 on Hopper (#23198)

2025-08-24 06:18:04 +00:00