vLLM/benchmarks/kernels at 16282a9c4ee754bedd67f72b01ac76ae8568dbdd - vLLM

cpu

[CPU][RISC-V] Add RVV-optimized attention kernels for RISC-V Vector Extension (#40119 )

2026-05-15 12:08:23 +08:00

deepgemm

Add platform manual_seed_all API (#38468 )

2026-04-10 13:43:50 +08:00

ir

[vLLM IR] Add IR op testing and benchmarking infrastructure (#40167 )

2026-04-21 00:23:03 +00:00

__init__.py

[vLLM IR] Add IR op testing and benchmarking infrastructure (#40167 )

2026-04-21 00:23:03 +00:00

bench_concat_mla_q.py

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917 )

2026-03-09 09:50:36 -07:00

bench_cp_gather_fp8.py

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290 )

2026-03-09 09:46:57 -07:00

benchmark_2d_silu_mul_fp8_quant.py

[Bugfix][CI] fix typos (#34934 )

2026-03-05 17:05:46 +00:00

benchmark_activation.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_block_fp8_gemm.py

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892 )

2026-04-09 08:50:39 +08:00

benchmark_cutlass_moe_fp8.py

[MoE] Move cutlass moe to fused_moe/experts/ (#40574 )

2026-04-24 06:05:49 +00:00

benchmark_cutlass_moe_nvfp4.py

[MoE] Move cutlass moe to fused_moe/experts/ (#40574 )

2026-04-24 06:05:49 +00:00

benchmark_device_communicators.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145 )

2026-03-12 07:57:47 -07:00

benchmark_fp8_gemm.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_fused_collective.py

[Bugfix] Fix benchmark_fused_collective.py (#38082 )

2026-03-25 23:51:00 -07:00

benchmark_fused_moe_lora_one_shot.py

[LoRA] Add one shot triton kernel For MoE LoRA (#42290 )

2026-05-25 19:47:04 -07:00

benchmark_fused_topk.py

[Kernel] Add topk_sigmoid kernel (#31246 )

2026-01-21 22:49:51 +00:00

benchmark_grouped_gemm_cutlass.py

[MoE] Move cutlass moe to fused_moe/experts/ (#40574 )

2026-04-24 06:05:49 +00:00

benchmark_int8_gemm.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_layernorm.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_lora.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_machete.py

[Refactor] Rename gptq_marlin to marlin to match MoE (#32952 )

2026-01-23 16:48:12 -05:00

benchmark_marlin.py

[Quantization][Deprecation] Remove Marlin 24 (#32688 )

2026-01-28 15:54:59 +00:00

benchmark_mla_k_concat.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_moe_align_block_size.py

Add platform manual_seed_all API (#38468 )

2026-04-10 13:43:50 +08:00

benchmark_moe_defaults.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_moe_permute_unpermute.py

[Perf] Optimize moe permute by pre-allocate buffer, 9~14% kernel performance improvement (#43014 )

2026-05-28 06:18:26 -07:00

benchmark_moe.py

[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184 )

2026-06-08 10:42:58 -04:00

benchmark_mrope.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_mxfp4_qutlass.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_gemm.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_quant.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_qutlass.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_paged_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_per_token_group_quant.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_per_token_quant_fp8.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_quant.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_reshape_and_cache_flash.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_reshape_and_cache.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_rmsnorm.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

benchmark_rope.py

[Bugfix] Fix kernel benchmark (#33752 )

2026-02-22 21:18:08 -08:00

benchmark_router_gemm.py

[PERF]MiniMax-M2 gate kernel (#38445 )

2026-05-29 18:28:34 -07:00

benchmark_selective_state_update.py

Tuning script and configs for Triton Mamba SSU kernel (#43083 )

2026-05-24 20:12:44 +03:00

benchmark_shapes.py

Disable nm-testing models with issues in CI (#28206 )

2025-11-06 06:19:07 -08:00

benchmark_silu_mul_fp8_quant.py

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005 )

2026-04-08 19:23:08 +00:00

benchmark_trtllm_decode_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_trtllm_prefill_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085 )

2026-03-05 10:36:39 +00:00

benchmark_vit_bilinear_pos_embed.py

[Perf] triton bilinear_pos_embed kernel for ViT (#37948 )

2026-04-01 01:52:02 -07:00

benchmark_vit_fp8_attn.py

[Perf] FP8 FlashInfer Attn for ViT (#38065 )

2026-04-27 13:44:15 +08:00

benchmark_w8a8_block_fp8.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145 )

2026-03-12 07:57:47 -07:00

graph_machete_bench.py

[Chore]:Extract math and argparse utilities to separate modules (#27188 )

2025-10-26 04:03:32 -07:00

requirements.txt

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701 )

2024-09-23 13:46:26 -04:00

utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

weight_shapes.py

[kernel] Support W4A8 on Hopper (#23198 )

2025-08-24 06:18:04 +00:00