vLLM/tests/kernels at 00972dfd72988942138a7a6089eaee08580210b8 - vLLM

Files

T

Fangzhou AiandCursor 00972dfd72 [ROCm][DSV4.1][Perf] Fold the mHC post step into the delayed pre projection (#56513 )

Signed-off-by: Fangzhou Ai <fangzhou@semianalysis.ai>
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

2026-09-14 16:44:56 -05:00

attention

[ROCm][DSV4.1][Perf] Stride the DSA decode candidate mask over the live context (#56628 )

2026-09-14 20:47:32 +00:00

core

[Refactor] Normalize DeepSeek V4.1 model package naming (#56741 )

2026-09-13 23:17:50 -07:00

helion

[CI/Build] Fix unused fake implementation testing (#55797 )

2026-09-08 03:36:18 +00:00

[Performance] Add Triton kernel for Gemma3n sparse GELU (#48498 )

2026-09-14 07:42:15 +00:00

mamba

[Model] add GLM-5.3-Flash support (#53906 )

2026-09-03 09:40:35 -07:00

moe

[Kernel][MoE] Optimize batched_moe_align_block_size with cooperative writes (#53280 )

2026-09-11 12:05:22 -07:00

quantization

[Quantization] Select linear backends per quantization (#51204 )

2026-09-14 16:24:18 -04:00

scripts

[CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117 )

2026-08-21 16:17:42 -05:00

turboquant

[Kernel][ROCm][Perf] FlyDSL decode-attention kernel for 4-bit TurboQuant KV cache (#47896 )

2026-08-11 08:45:39 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425 )

2024-05-13 23:50:09 +09:00

allclose_default.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

conftest.py

[CI] Fix stale/fragile untethered kernels-root tests (#49423 )

2026-07-22 14:43:07 -06:00

quant_utils.py

[XPU][Tests] Make tests device-agnostic (#51968 )

2026-08-20 02:25:41 -07:00

test_apply_repetition_penalties.py

[Platform] Deprecate seed_everything (#31659 )

2026-01-04 18:34:04 -08:00

test_awq_int4_to_int8.py

[CPU] Bump up to the latest CPU kernels (#41924 )

2026-05-07 05:45:59 -07:00

test_bf16_skinny_gemm.py

[Bugfix][Kimi-K3] Fix KDA projection overlap on Hopper (#55426 )

2026-09-11 19:07:30 +00:00

test_bf16x3_router_gemm_cutedsl.py

[Perf] Improve BF16x3 router GEMM accuracy and make it default on sm100 (#55899 )

2026-09-09 07:33:12 -07:00

test_cache_kernels.py

[Bugfix] Restore gather_and_maybe_dequant_cache OOB guard (#49427 )

2026-07-22 13:47:37 -07:00

test_compressor_kv_cache.py

[Refactor] Normalize DeepSeek V4.1 model package naming (#56741 )

2026-09-13 23:17:50 -07:00

test_concat_mla_q.py

[Perf][GLM5.2] Fuse sparse MLA Q concatenation with head padding (#53878 )

2026-08-27 11:54:32 -04:00

test_cp_gather_fp8.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_deepseek_v4_cpu_kernels.py

[Model] Add DeepSeek-V4 CPU backend (#55355 )

2026-09-10 14:14:48 +08:00

test_engram.py

[Refactor] Normalize DeepSeek V4.1 model package naming (#56741 )

2026-09-13 23:17:50 -07:00

test_fla_layernorm_guard.py

[Kernel] Warm up Qwen GDN gated RMSNorm (#54251 )

2026-09-03 18:19:48 +08:00

test_flashinfer_bf16_gemm.py

[kernel] Integrate FlashInfer BF16 CuTeDSL Low Latency GEMM (#50572 )

2026-08-27 22:29:12 +00:00

test_flex_attention.py

[Bugfix] Avoid FlexAttention recompiles when request counts change (#55888 )

2026-09-09 08:10:25 -07:00

test_fp32_router_gemm.py

[Kernel] Retire the DSv3 router GEMM CUDA kernel (#54040 )

2026-08-31 07:15:31 +00:00

test_fused_deepseek_v4_qnorm_rope_kv_insert.py

[Kernel] Optional Q-norm in fused DSv4 MLA epilogue; group_size=32 for packed FP8 quant (#56215 )

2026-09-10 00:35:59 -07:00

test_fused_deepseek_v32_norm_rope.py

[Bugfix][DSA] Write nvfp4_ds_mla from the fused norm+rope kernel (#55538 )

2026-09-15 00:25:33 +04:00

test_fused_gdn_post_conv.py

[Model] Support Qwen3.8-Flash-Next (#53896 )

2026-08-31 05:57:56 +00:00

test_fused_indexer_q_rope_quant.py

[Refactor] Normalize DeepSeek V4.1 model package naming (#56741 )

2026-09-13 23:17:50 -07:00

test_fused_inv_rope_fp8_quant.py

[Model] Support DeepSeek-V4.1-Flash (#56214 )

2026-09-11 02:11:19 -07:00

test_fused_minimax_m3_qknorm_rope_kv_insert.py

[Attention][MiniMax-M3] Add MSA speculative decode verification (#50032 )

2026-08-02 13:46:55 -07:00

test_fused_qk_norm_rope_gate.py

[Kernel][Perf] Enable fused QK-norm + partial MRoPE + gate for Qwen3.6 (#52676 )

2026-08-24 18:28:49 -07:00

test_fused_quant_activation.py

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793 )

2026-09-14 10:26:15 -07:00

test_fused_recurrent_packed_decode.py

[Bugfix][Kernel] Keep packed GDN decode beta in FP32 (#53877 )

2026-08-30 22:15:36 +08:00

test_fused_sigmoid_gating_delta_rule.py

[CI] Fix stale/fragile untethered kernels-root tests (#49423 )

2026-07-22 14:43:07 -06:00

test_gate_linear_rocm_dispatch.py

[ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845 )

2026-09-03 10:42:25 -07:00

test_kimi_k3_gemm_rs_ar.py

[Kimi-K3] Extend GEMM-RS to GEMM-AR (#53053 )

2026-08-21 03:44:15 +00:00

test_kpool_decode_update_batched.py

[Model] add GLM-5.3-Flash support (#53906 )

2026-09-03 09:40:35 -07:00

test_ll_bf16_gemm.py

[Kimi-K3][Perf] Prefetch ll_bf16 router weights for M=1 (#53524 )

2026-09-01 21:40:19 +00:00

test_mhc_jit_warmup.py

[Perf][DSv4.1] Fold the mHC post block into the delayed pre projection (#56633 )

2026-09-14 18:57:37 +00:00

test_mhc_kernels.py

[ROCm][DSV4.1][Perf] Fold the mHC post step into the delayed pre projection (#56513 )

2026-09-14 16:44:56 -05:00

test_mhc_tilelang_jit.py

[CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117 )

2026-08-21 16:17:42 -05:00

test_minimax_m3_amd_ops.py

[ROCm][MoE] Fix expert_map vs AITER expert_mask for non-AITER experts under EP (#49758 )

2026-08-11 15:33:02 -05:00

test_minimax_m3_sparse_attn_fp8_scale.py

[ROCm][MiniMax-M3] Add AITER sparse paged attention (#47287 )

2026-07-12 19:27:29 -07:00

test_onednn.py

[CPU] Speedup LM Head on Arm CPUs (#55352 )

2026-09-11 16:21:14 +08:00

test_relu2_fp8_quant.py

[Perf][Kernel][Quantization] Fuse ReLU2 with static FP8 activation quantization (#53793 )

2026-09-14 10:26:15 -07:00

test_rocm_fp32_router_gemm.py

[ROCm][Perf] Add low-M FP32 router GEMM for gfx950 (#54845 )

2026-09-03 10:42:25 -07:00

test_shuffle_rows.py

[Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747 )

2026-09-01 19:08:17 -07:00

test_top_k_per_row.py

[Perf][Kernel] Integrate DeepSelect TopK for the DSA sparse indexer (#56464 )

2026-09-13 00:44:37 -07:00

utils.py

[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375 )

2026-08-05 21:27:33 +00:00